Programming

Programming Questions? Ask a Programmer for Answers ASAP

Ask a Computer Expert,
Get an Answer ASAP!

Programming

I use R . I'm trying to login to a webpage and read the

Customer Question
I use R for scraping...
I use R for scraping. I'm trying to login to a webpage and read the content afterwards, but it's not successful. Here is the code:
destination <- "http://artsalesindex.artinfo.com/auctions/Lajos-A-1897312/Portrait-of-young-lady-with-feather-fan-1885"
result <- POST(destination,
endoce ="form",
body = list( lightboxusername="username", lightboxpassword="password")
)
piece_html <-read_html(result)
x % html_nodes(".style14Reg222") %>% html_text()
if (length(x)==0) {price2 <- "NA"} else{price2 <- x}
Submitted: 1 year ago.Category: Programming
Show More
Show Less
Ask Your Own Programming Question
Customer reply replied 1 year ago
piece_html <-read_html(result)
x <- piece_html %>% html_nodes(".style14Reg222") %>% html_text()
if (length(x)==0) {price2 <- "NA"} else{price2 <- x}is actually correct
Answered in 7 hours by:
6/4/2016
Programmer: Pete, Computer Engineer replied 1 year ago
Pete
Pete, Computer Engineer
Category: Programming
Satisfied Customers: 18,995
Experience: Over 16 years of experience in computer programming.
Verified

Hi there,

Did you get the correct code sorted?

Ask Your Own Programming Question
Customer reply replied 1 year ago
There was a typo in the first question I sent, here is the code I have, but it still does not work.
destination <- "http://artsalesindex.artinfo.com/auctions/Lajos-A-1897312/Portrait-of-young-lady-with-feather-fan-1885"
result <- POST(destination,endoce ="form",
body = list( lightboxusername="username", lightboxpassword="password")
)
piece_html <-read_html(result)
x <- piece_html %>% html_nodes(".style14Reg222") %>% html_text()
if (length(x)==0) {price2 <- "NA"} else{price2 <- x}My goal is to read data fields such as PRICE SOLD and ORIGINAL CURRENCY OF SALE which show up after login.
Customer reply replied 1 year ago
I can give you my user and pass if it's necessary.
Programmer: Pete, Computer Engineer replied 1 year ago

Is it reading, but reporting incorrect data, or not reading at all?

Ask Your Own Programming Question
Customer reply replied 1 year ago
here is a complete description. For the exact same url I provided above, there are two page sources. One is before login, and the other after login.With the code I provided, I can read the data fields which is publicly available( such as title, year, medium, ...), but I cannot read those those that show up in the page source after login ( such as PRICE SOLD). I think POST command should somehow post the login form required to the website, and get back the response, and the response should be the page source after login; but apparently it doesn't. It should be very easy to check with Rstudio.
For example I can easily read title field with these line, since it is in the page source before login.
x <- piece_html %>% html_nodes(".style16Italic222") %>% html_text()
if (length(x)==0) {title <- "NA"} else {title <- x}
but I cannot read the PRICE SOLD and ORIGINAL CURRENCY OF SALE.The result is "PRICE SOLD\n" , and NA respectively. SO I guess it does not read the page source after login.
Customer reply replied 1 year ago
html nodes after login should be .style14Reg222 for price, and .style13Reg222 for original currency of sale.
Programmer: Pete, Computer Engineer replied 1 year ago

Are you only interested in the one site, or have you tried the code with any other sites?

Ask Your Own Programming Question
Customer reply replied 1 year ago
I'm interested in just this website.
Programmer: Pete, Computer Engineer replied 1 year ago

I can't see anything wrong with the code, so I'm not sure why it's not working with this website.

I'll check with the other experts to see if they have any ideas...

Ask Your Own Programming Question
Customer reply replied 1 year ago
The issue is logging in. The part which reads the nodes should be fine, and it can read different publicly available fields. But for reading I have to give url plus credentials, which credentials are posted by POST command, which I guess does not do the job. let me know if you need credentials so you can check the page sources before and after login.
Customer reply replied 1 year ago
could it because there are several forms in the webpage? but I don't know how to target just one form .
Ask Pete Your Own Question
Pete
Pete
Pete, Computer Engineer
Category: Programming
Satisfied Customers: 18,995
18,995 Satisfied Customers
Experience: Over 16 years of experience in computer programming.

Pete is online now

A new question is answered every 9 seconds

How JustAnswer works:

  • Ask an ExpertExperts are full of valuable knowledge and are ready to help with any question. Credentials confirmed by a Fortune 500 verification firm.
  • Get a Professional AnswerVia email, text message, or notification as you wait on our site. Ask follow up questions if you need to.
  • 100% Satisfaction GuaranteeRate the answer you receive.

JustAnswer in the News:

Ask-a-doc Web sites: If you've got a quick question, you can try to get an answer from sites that say they have various specialists on hand to give quick answers... Justanswer.com.
JustAnswer.com...has seen a spike since October in legal questions from readers about layoffs, unemployment and severance.
Web sites like justanswer.com/legal
...leave nothing to chance.
Traffic on JustAnswer rose 14 percent...and had nearly 400,000 page views in 30 days...inquiries related to stress, high blood pressure, drinking and heart pain jumped 33 percent.
Tory Johnson, GMA Workplace Contributor, discusses work-from-home jobs, such as JustAnswer in which verified Experts answer people’s questions.
I will tell you that...the things you have to go through to be an Expert are quite rigorous.

What Customers are Saying:

My Expert answered my question promptly and he resolved the issue totally. This is a great service. I am so glad I found it I will definitely use the service again if needed.

One Happy CustomerNew York

Wonderful service, prompt, efficient, and accurate. Couldn't have asked for more. I cannot thank you enough for your help.

Mary C.Freshfield, Liverpool, UK

This expert is wonderful. They truly know what they are talking about, and they actually care about you. They really helped put my nerves at ease. Thank you so much!!!!

AlexLos Angeles, CA

Thank you for all your help. It is nice to know that this service is here for people like myself, who need answers fast and are not sure who to consult.

GPHesperia, CA

I couldn't be more satisfied! This is the site I will always come to when I need a second opinion.

JustinKernersville, NC

Just let me say that this encounter has been entirely professional and most helpful. I liked that I could ask additional questions and get answered in a very short turn around.

EstherWoodstock, NY

Thank you so much for taking your time and knowledge to support my concerns. Not only did you answer my questions, you even took it a step further with replying with more pertinent information I needed to know.

RobinElkton, Maryland

< Previous | Next >

Meet the Experts:

ATLPROG

ATLPROG

Computer Software Engineer

7,677 satisfied customers

MS in IT.Several years of programming experience in Java C++ C C# Python VB Javascript HTML

LogicPro

LogicPro

Computer Software Engineer

7,131 satisfied customers

Expert in C, C++, Java, DOT NET, Python, HTML, Javascript, Design.

unvadim

unvadim

Computer Software Engineer

1,168 satisfied customers

Good knowledge of OOP principles. 3+ years of programming experience with Java and C++. Sun Certified Java Programmer 5.0.

lifesaver

lifesaver

Computer Software Engineer

950 satisfied customers

Several years of intensive programming and application development experience in various platforms.

ehabtutor

ehabtutor

Computer Software Engineer

936 satisfied customers

Bachelor of computer science, 5+ years experience in software development, software company owner

TheDoctor

TheDoctor

Software Engineer

893 satisfied customers

M.S. in Internet Information Systems

The-PC-Guy

The-PC-Guy

Software Engineer

800 satisfied customers

Extensive Knowledge in PHP, MYSQL, CSS & Javascript

< Previous | Next >

Related Programming Questions
My account was seriously hacked. I bought a new phone it was
My account was seriously hacked. I bought a new phone it was so bad. To my surprise they apparently set up a fake FB account. Now I cannot get into my account. The account it keeps pulling up is not m… read more
Pete
Pete
Computer Engineer
18,995 satisfied customers
My Microsoft Word and Excel app now require Office 365. They
My Microsoft Word and Excel app now require Office 365. They didn't when I installed the apps. I have them linked to Dropbox files. ???? … read more
Jinsmn
Jinsmn
Systems Administrator
Diplom
1,260 satisfied customers
I am new to word press and downloaded the wordpress.org and
i am new to word press and downloaded the wordpress.org and paid for the business plan and hosted by Bluehost I purchased a theme for Buz theme called the-multiple-pro which they sent a zip file I sep… read more
Chris L.
Chris L.
IT/Web Manager
Vocational, Technical or Trade Scho
29 satisfied customers
I want to pass a csv file twice. The first pass works
I want to pass a csv file twice. The first pass works perfectly: LAreader = csv.reader(open(InFileName,'r')) for line in LAreader: SvcDepNamesSet.add (line[0].strip())When I try a second time, there i… read more
George Sibiya
George Sibiya
PhD
217 satisfied customers
Can I ask you about this question At Olympic diving
Hi Can I ask you about this question At Olympic diving competition level, 10 diving judges award At Olympic diving competition level, 10 diving judges award a single mark (with one decimal place) for … read more
LogicPro
LogicPro
Computer Software Engineer
Bachelor of Technology
7,131 satisfied customers
I have had a mailing list in excel (personal) for years. Can
I have had a mailing list in excel (personal) for years. Can you help me find it so I can update it?? … read more
Sheri
Sheri
Bachelor\u0027s Degree
102 satisfied customers
I need to design an antisense oligo against beta catenin and
I need to design an antisense oligo against beta catenin and HCV-related sequences for clinical use … read more
Kris R
Kris R
IT Manager
Computing
2,652 satisfied customers
I need to know how to create and move a stack of playing
I need to know how to create and move a stack of playing cards in visual basic … read more
Ingo U
Ingo U
Master\u0027s Degree
357 satisfied customers
Write a C++ program to read in various types of test
Write a C++ program to read in various types of test questions (multiple choice and True/False) from a test bank (text file), and load the questions into an array of questions. You will need to implem… read more
LogicPro
LogicPro
Computer Software Engineer
Bachelor of Technology
7,131 satisfied customers
I want to copy a formula horizontally across a row and can't
I want to copy a formula horizontally across a row and can't get it to repeat … read more
The-PC-Guy
The-PC-Guy
Software Engineer
Bachelor's Degree
800 satisfied customers
I'm trying to make a python object oriented checkers game,
I'm trying to make a python object oriented checkers game, but I'm lost. I'm trying to find a source code for a python checkers game. Is there any way you would be able to help me … read more
George Sibiya
George Sibiya
PhD
217 satisfied customers
I have a spreadsheet with customer sales and market
I have a spreadsheet with customer sales and market information for the first half of 2017. The list has over 10,000 rows. I added the market segment manually from a drop down menu. Very time consumin… read more
The-PC-Guy
The-PC-Guy
Software Engineer
Bachelor's Degree
800 satisfied customers
Not sure how to explain this...but I have an excel report
Hi! Not sure how to explain this...but I have an excel report with a field name for first name and one for last name. The report contains multiple people from the same household, one row for each. Eac… read more
The-PC-Guy
The-PC-Guy
Software Engineer
Bachelor's Degree
800 satisfied customers
Wanting to insert function into a invoice I am building on
wanting to insert function into a invoice I am building on excel, how to add a subtraction … read more
The-PC-Guy
The-PC-Guy
Software Engineer
Bachelor's Degree
800 satisfied customers
How do I get my restored Microsoft Wordpad .rtf files to
How do I get my restored Microsoft Wordpad .rtf files to stop coming up in Landscape orientation. I want them to normally come up in Portrait orientation? (Tech Viet helped me a few days ago.)… read more
David L.
David L.
Bachelor\u0027s Degree
6 satisfied customers
I am looking for help understanding the content of some
Hi. I am looking for help understanding the content of some files. Ideally, I could have someone explain what certain things mean so that I am not making assumptions. The files are in HTML, JS, SQL, a… read more
George Sibiya
George Sibiya
PhD
217 satisfied customers
Searching for a tutorial on WordPress theme ColorMag Pro -
Searching for a tutorial on WordPress theme ColorMag Pro - some I have found have no sound and or the narration isn't understandable. … read more
RussellA
RussellA
Solutions Architect
Bachelor\u0027s Degree
123 satisfied customers
VWorker01.pyw import sys; print (sys.version) n = 4; m = 2 M
vWorker01.pyw import sys; print (sys.version) n = 4; m = 2 M = n * [n * [0.0]] print("show M contents: ") print (M) for i in iter(range(m,n)): M[i][i] = 1.0 print ("show M contents: ") print(M)# For c… read more
George Sibiya
George Sibiya
PhD
217 satisfied customers
Disclaimer: Information in questions, answers, and other posts on this site ("Posts") comes from individual users, not JustAnswer; JustAnswer is not responsible for Posts. Posts are for general information, are not intended to substitute for informed professional advice (medical, legal, veterinary, financial, etc.), or to establish a professional-client relationship. The site and services are provided "as is" with no warranty or representations by JustAnswer regarding the qualifications of Experts. To see what credentials have been verified by a third-party service, please click on the "Verified" symbol in some Experts' profiles. JustAnswer is not intended or designed for EMERGENCY questions which should be directed immediately by telephone or in-person to qualified professionals.

Disclaimer: Information in questions, answers, and other posts on this site ("Posts") comes from individual users, not JustAnswer; JustAnswer is not responsible for Posts. Posts are for general information, are not intended to substitute for informed professional advice (medical, legal, veterinary, financial, etc.), or to establish a professional-client relationship. The site and services are provided "as is" with no warranty or representations by JustAnswer regarding the qualifications of Experts. To see what credentials have been verified by a third-party service, please click on the "Verified" symbol in some Experts' profiles. JustAnswer is not intended or designed for EMERGENCY questions which should be directed immediately by telephone or in-person to qualified professionals.

Show MoreShow Less

Ask Your Question

x