FYI...
-------- Original Message -------- Subject: USENIX WebApps '10 Registration Now Open Date: Mon, 19 Apr 2010 11:20:33 -0700 From: Lionel Garth Jones lgj@usenix.org To: info@muug.mb.ca, gedetil@muug.mb.ca
You're invited to join us in Boston, June 23-24, 2010, for the first USENIX Conference on Web Application Development. WebApps '10 is a new technical conference designed to bring together experts in all aspects of developing and deploying Web applications.
Web-based applications are revolutionizing both the features that can be delivered and the technologies for developing and deploying applications. They also involve a diverse collection of issues and technologies. Take advantage of this new opportunity for interaction and synergy across these areas.
The program includes:
* Invited talks by industry leaders including Adam de Boor, Google, on "Gmail: Past, Present, and Future"
* Refereed papers on a variety of topics such as new approaches to Web frameworks, techniques for giving users control over their Web data, better ways of managing Ajax and Javascript, and a variety of security issues ranging from better CAPTCHAs to information flow tracking.
* A Poster Session and Happy Hour held jointly with USENIX ATC '10. The poster session provides a great way to let other people know about your work and to get useful feedback from the community. Submissions are due on June 13, 2010.
* Work-in-Progress Reports. If you have work you would like to share, a controversial opinion, or a cool idea that's not quite ready for publication, submit a WiP by June 13, 2010.
Find out more about the posters and WiPs at: http://www.usenix.org/events/webapps10/posters_wips.html
WebApps '10 is part of the USENIX Federated Conferences Week. Not only do you get a 2-day conference program filled with the latest research, but you'll also have additional opportunities to mingle with colleagues and leading experts in the combined Birds-of-a-Feather sessions (BoFs) and at the various evening social events, vendor BoFs, and receptions.
Your WebApps '10 registration gets you into all the ConfWeek events happening those days: tutorials, talks, workshops--you name it. Plus, registration packages offer expanded discounts. The more days you attend, the more you save!
http://www.usenix.org/confweek10
The full WebApps '10 program is available at http://www.usenix.org/webapps10/proga
Register by June 7, 2010, for the greatest savings.
* Additional registration discounts are available! Discount types include hardship, government, and non-profit: http://www.usenix.org/events/confweek10/discounts.html
* Help spread the word! http://www.usenix.org/events/webapps10/promote.html
I look forward to seeing you in Boston!
Sincerely,
John Ousterhout, Stanford University WebApps '10 Program Chair webapps10chair@usenix.org
------------------------------------------------------------------------ USENIX Conference on Web Application Development (WebApps '10) June 23-24, 2010, Boston, MA http://www.usenix.org/webapps10/proga http://www.usenix.org/confweek10 Poster and WiPs Submissions Deadline: May 27, 2010 Early Bird Registration Deadline: June 7, 2010 ------------------------------------------------------------------------
I am learning to navigate and scrape. I have had more success with Firewatir than Ruby mechanize, but both are poorly documented.
Current problem: logging into a site webpage, Firwatir can see the frames, but cannot access them.
browser.show_frames
There are 3 frames frame: name: topbar index: 1 frame: name: langFrame index: 2 frame: name: main index: 3 => 0..2
browser.frame(:index, 1)
=> #<FireWatir::Frame:0x1a9260c located=false how=:index what=1>
browser.frame("main")
=> #<FireWatir::Frame:0x1a90dd4 located=false how=:name what="main">
Firefox shows the webpage source [I show only the top levels] structure as:
<html>
<head> <meta http-equiv="content-type" content="text/html;charset=iso-8859-1"> <title>TITLE</title> <link rel="stylesheet" href="all.css">
<script language="JavaScript" src="WEBPAGE"></script> <script language="JavaScript">FUNCTIONS</script> </head>
<frameset rows="63,0,*" border="0" id="frameset_ID" framespacing="0" frameborder="no" onload="loadHomepage(1);" onunload="forceLogout();"> <frame src="/TDM/header.htm" name="topbar" scrolling="no" noresize>STUFF IN HERE</frame>
<frame name="langFrame" src="lang.html">STUFF IN HERE</frame> <frame src="" id="main_ID" name="main" noresize>STUFF IN HERE THAT I WANT</frame> </frameset>
<noframes> STUFF IN HERE </noframes>
</html>
I cannot access any forms etc included in the frame unless I can name / access the frame. Any ideas?
Dan Martin GP Hospital Practitioner Computer Scientist ummar143@shaw.ca (204) 831-1746 answering machine always on
Looking at the rdocs, http://wtr.rubyforge.org/rdoc/1.6.5/, have you tried
browser.frame("main").html
?
On Tue, Apr 20, 2010 at 10:51 AM, Dan Martin ummar143@shaw.ca wrote:
I am learning to navigate and scrape. I have had more success with Firewatir than Ruby mechanize, but both are poorly documented.
Current problem: logging into a site webpage, Firwatir can see the frames, but cannot access them.
browser.show_frames
There are 3 frames frame: name: topbar index: 1 frame: name: langFrame index: 2 frame: name: main index: 3 => 0..2
browser.frame(:index, 1)
=> #<FireWatir::Frame:0x1a9260c located=false how=:index what=1>
browser.frame("main")
=> #<FireWatir::Frame:0x1a90dd4 located=false how=:name what="main">
Firefox shows the webpage source [I show only the top levels] structure as:
<html>
<head> <meta http-equiv="content-type" content="text/html;charset=iso-8859-1"> <title>TITLE</title> <link rel="stylesheet" href="all.css">
<script language="JavaScript" src="WEBPAGE"></script> <script language="JavaScript">FUNCTIONS</script></head>
<frameset rows="63,0,*" border="0" id="frameset_ID" framespacing="0"frameborder="no" onload="loadHomepage(1);" onunload="forceLogout();"> <frame src="/TDM/header.htm" name="topbar" scrolling="no" noresize>STUFF IN HERE</frame>
<frame name="langFrame" src="lang.html">STUFF INHERE</frame> <frame src="" id="main_ID" name="main" noresize>STUFF IN HERE THAT I WANT</frame> </frameset>
<noframes> STUFF IN HERE </noframes></html>
I cannot access any forms etc included in the frame unless I can name / access the frame. Any ideas?
Dan Martin GP Hospital Practitioner Computer Scientist ummar143@shaw.ca (204) 831-1746 answering machine always on
Roundtable mailing list Roundtable@muug.mb.ca http://www.muug.mb.ca/mailman/listinfo/roundtable
As noted in the previous email
browser.frame("main")
=> #<FireWatir::Frame:0x1a90dd4 located=false how=:name what="main">
"located=false" seems to be Firewatir's way of saying that the object doesn't exist until I ask for it. If I try to use it anyway, I get an unknown object exception
browser.frame("main").html
Watir::Exception::UnknownObjectException: Unable to locate element, using :name, "main" from /Library/Ruby/Gems/1.8/gems/firewatir-1.6.5/lib/firewatir/ element.rb:907:in `assert_exists' from /Library/Ruby/Gems/1.8/gems/firewatir-1.6.5/lib/firewatir/ elements/frame.rb:34:in `html' from (irb):62
On 20-Apr-10, at 11:34 AM, Sean Walberg wrote:
Looking at the rdocs, http://wtr.rubyforge.org/rdoc/1.6.5/, have you tried
browser.frame("main").html
?
On Tue, Apr 20, 2010 at 10:51 AM, Dan Martin ummar143@shaw.ca wrote: I am learning to navigate and scrape. I have had more success with Firewatir than Ruby mechanize, but both are poorly documented.
Current problem: logging into a site webpage, Firwatir can see the frames, but cannot access them.
browser.show_frames
There are 3 frames frame: name: topbar index: 1 frame: name: langFrame index: 2 frame: name: main index: 3 => 0..2
browser.frame(:index, 1)
=> #<FireWatir::Frame:0x1a9260c located=false how=:index what=1>
browser.frame("main")
=> #<FireWatir::Frame:0x1a90dd4 located=false how=:name what="main">
Firefox shows the webpage source [I show only the top levels] structure as:
<html>
<head> <meta http-equiv="content-type" content="text/ html;charset=iso-8859-1"> <title>TITLE</title> <link rel="stylesheet" href="all.css">
<script language="JavaScript" src="WEBPAGE"></script> <script language="JavaScript">FUNCTIONS</script></head>
<frameset rows="63,0,*" border="0" id="frameset_ID"framespacing="0" frameborder="no" onload="loadHomepage(1);" onunload="forceLogout();"> <frame src="/TDM/header.htm" name="topbar" scrolling="no" noresize>STUFF IN HERE</frame>
<frame name="langFrame" src="lang.html">STUFF INHERE</frame> <frame src="" id="main_ID" name="main" noresize>STUFF IN HERE THAT I WANT</frame> </frameset>
<noframes> STUFF IN HERE </noframes></html>
I cannot access any forms etc included in the frame unless I can name / access the frame. Any ideas?
Dan Martin GP Hospital Practitioner Computer Scientist ummar143@shaw.ca (204) 831-1746 answering machine always on
Roundtable mailing list Roundtable@muug.mb.ca http://www.muug.mb.ca/mailman/listinfo/roundtable
-- Sean Walberg sean@ertw.com http://ertw.com/ _______________________________________________ Roundtable mailing list Roundtable@muug.mb.ca http://www.muug.mb.ca/mailman/listinfo/roundtable
Dan Martin GP Hospital Practitioner Computer Scientist ummar143@shaw.ca (204) 831-1746 answering machine always on
If you RTSL a bit you'll see that calling browser.frame creates a new element but doesn't validate it actually found anything. When you call the html method it first asserts that the object exists and throws an exception if not.
The located=false comes from the element#inspect method, (which just taught me a new Ruby idiom: !!@o returns true if @o is a valid object or false if it isn't.) So located=false means that the object never existed, nor will it ever.
While poking around I saw a locate_frame method. Maybe that might work better? (It's actually possible that .frame uses locate_frame, I didn't trace it far enough)
Failing that, what about opening the frame directly?
Sean
On Tue, Apr 20, 2010 at 12:05 PM, Dan Martin ummar143@shaw.ca wrote:
As noted in the previous email
browser.frame("main")
=> #<FireWatir::Frame:0x1a90dd4 located=false how=:name what="main">
"located=false" seems to be Firewatir's way of saying that the object doesn't exist until I ask for it. If I try to use it anyway, I get an unknown object exception
browser.frame("main").html
Watir::Exception::UnknownObjectException: Unable to locate element, using :name, "main" from /Library/Ruby/Gems/1.8/gems/firewatir-1.6.5/lib/firewatir/element.rb:907:in `assert_exists' from /Library/Ruby/Gems/1.8/gems/firewatir-1.6.5/lib/firewatir/elements/frame.rb:34:in `html' from (irb):62
On 20-Apr-10, at 11:34 AM, Sean Walberg wrote:
Looking at the rdocs, http://wtr.rubyforge.org/rdoc/1.6.5/, have you tried
browser.frame("main").html
?
On Tue, Apr 20, 2010 at 10:51 AM, Dan Martin ummar143@shaw.ca wrote:
I am learning to navigate and scrape. I have had more success with Firewatir than Ruby mechanize, but both are poorly documented.
Current problem: logging into a site webpage, Firwatir can see the frames, but cannot access them.
browser.show_frames
There are 3 frames frame: name: topbar index: 1 frame: name: langFrame index: 2 frame: name: main index: 3 => 0..2
browser.frame(:index, 1)
=> #<FireWatir::Frame:0x1a9260c located=false how=:index what=1>
browser.frame("main")
=> #<FireWatir::Frame:0x1a90dd4 located=false how=:name what="main">
Firefox shows the webpage source [I show only the top levels] structure as:
<html>
<head> <meta http-equiv="content-type" content="text/html;charset=iso-8859-1"> <title>TITLE</title> <link rel="stylesheet" href="all.css">
<script language="JavaScript" src="WEBPAGE"></script> <script language="JavaScript">FUNCTIONS</script></head>
<frameset rows="63,0,*" border="0" id="frameset_ID"framespacing="0" frameborder="no" onload="loadHomepage(1);" onunload="forceLogout();"> <frame src="/TDM/header.htm" name="topbar" scrolling="no" noresize>STUFF IN HERE</frame>
<frame name="langFrame" src="lang.html">STUFF INHERE</frame> <frame src="" id="main_ID" name="main" noresize>STUFF IN HERE THAT I WANT</frame> </frameset>
<noframes> STUFF IN HERE </noframes></html>
I cannot access any forms etc included in the frame unless I can name / access the frame. Any ideas?
Dan Martin GP Hospital Practitioner Computer Scientist ummar143@shaw.ca (204) 831-1746 answering machine always on
Roundtable mailing list Roundtable@muug.mb.ca http://www.muug.mb.ca/mailman/listinfo/roundtable
-- Sean Walberg sean@ertw.com http://ertw.com/ _______________________________________________ Roundtable mailing list Roundtable@muug.mb.ca http://www.muug.mb.ca/mailman/listinfo/roundtable
Dan Martin GP Hospital Practitioner Computer Scientist ummar143@shaw.ca (204) 831-1746 answering machine always on
Roundtable mailing list Roundtable@muug.mb.ca http://www.muug.mb.ca/mailman/listinfo/roundtable
interesting - I get an "unknown frame exception" instead of an "unknown object exception" using locate.
browser.frame("main").locate()
Watir::Exception::UnknownFrameException: Unable to locate a frame using name and main. from /Library/Ruby/Gems/1.8/gems/firewatir-1.6.5/lib/firewatir/ elements/frame.rb:29:in `locate' from (irb):66
browser.frame("main").locate_frame(:name, 'main')
Watir::Exception::UnknownObjectException: Unable to locate element, using :name, "main" from /Library/Ruby/Gems/1.8/gems/firewatir-1.6.5/lib/firewatir/ element.rb:907:in `assert_exists' from /Library/Ruby/Gems/1.8/gems/firewatir-1.6.5/lib/firewatir/ element.rb:1266:in `method_missing' from (irb):64
How would I open the frame directly? The frame I want has an ID, even this doesn't help.
An Xpath search fails:
browser.element_by_xpath('//*[@id="main_ID"]')
=> #<FireWatir::Link:0x1a7fdcc located=false how=:jssh_name what=nil>
On 20-Apr-10, at 12:35 PM, Sean Walberg wrote:
If you RTSL a bit you'll see that calling browser.frame creates a new element but doesn't validate it actually found anything. When you call the html method it first asserts that the object exists and throws an exception if not.
The located=false comes from the element#inspect method, (which just taught me a new Ruby idiom: !!@o returns true if @o is a valid object or false if it isn't.) So located=false means that the object never existed, nor will it ever.
While poking around I saw a locate_frame method. Maybe that might work better? (It's actually possible that .frame uses locate_frame, I didn't trace it far enough)
Failing that, what about opening the frame directly?
Sean
On Tue, Apr 20, 2010 at 12:05 PM, Dan Martin ummar143@shaw.ca wrote: As noted in the previous email
browser.frame("main")
=> #<FireWatir::Frame:0x1a90dd4 located=false how=:name what="main">
"located=false" seems to be Firewatir's way of saying that the object doesn't exist until I ask for it. If I try to use it anyway, I get an unknown object exception
browser.frame("main").html
Watir::Exception::UnknownObjectException: Unable to locate element, using :name, "main" from /Library/Ruby/Gems/1.8/gems/firewatir-1.6.5/lib/firewatir/ element.rb:907:in `assert_exists' from /Library/Ruby/Gems/1.8/gems/firewatir-1.6.5/lib/firewatir/ elements/frame.rb:34:in `html' from (irb):62
On 20-Apr-10, at 11:34 AM, Sean Walberg wrote:
Looking at the rdocs, http://wtr.rubyforge.org/rdoc/1.6.5/, have you tried
browser.frame("main").html
?
On Tue, Apr 20, 2010 at 10:51 AM, Dan Martin ummar143@shaw.ca wrote: I am learning to navigate and scrape. I have had more success with Firewatir than Ruby mechanize, but both are poorly documented.
Current problem: logging into a site webpage, Firwatir can see the frames, but cannot access them.
browser.show_frames
There are 3 frames frame: name: topbar index: 1 frame: name: langFrame index: 2 frame: name: main index: 3 => 0..2
browser.frame(:index, 1)
=> #<FireWatir::Frame:0x1a9260c located=false how=:index what=1>
browser.frame("main")
=> #<FireWatir::Frame:0x1a90dd4 located=false how=:name what="main">
Firefox shows the webpage source [I show only the top levels] structure as:
<html>
<head> <meta http-equiv="content-type" content="text/ html;charset=iso-8859-1"> <title>TITLE</title> <link rel="stylesheet" href="all.css">
<script language="JavaScript" src="WEBPAGE"></script> <script language="JavaScript">FUNCTIONS</script></head>
<frameset rows="63,0,*" border="0" id="frameset_ID"framespacing="0" frameborder="no" onload="loadHomepage(1);" onunload="forceLogout();"> <frame src="/TDM/header.htm" name="topbar" scrolling="no" noresize>STUFF IN HERE</frame>
<frame name="langFrame" src="lang.html">STUFF INHERE</frame> <frame src="" id="main_ID" name="main" noresize>STUFF IN HERE THAT I WANT</frame> </frameset>
<noframes> STUFF IN HERE </noframes></html>
I cannot access any forms etc included in the frame unless I can name / access the frame. Any ideas?
Dan Martin GP Hospital Practitioner Computer Scientist ummar143@shaw.ca (204) 831-1746 answering machine always on
Roundtable mailing list Roundtable@muug.mb.ca http://www.muug.mb.ca/mailman/listinfo/roundtable
-- Sean Walberg sean@ertw.com http://ertw.com/ _______________________________________________ Roundtable mailing list Roundtable@muug.mb.ca http://www.muug.mb.ca/mailman/listinfo/roundtable
Dan Martin GP Hospital Practitioner Computer Scientist ummar143@shaw.ca (204) 831-1746 answering machine always on
Roundtable mailing list Roundtable@muug.mb.ca http://www.muug.mb.ca/mailman/listinfo/roundtable
-- Sean Walberg sean@ertw.com http://ertw.com/ _______________________________________________ Roundtable mailing list Roundtable@muug.mb.ca http://www.muug.mb.ca/mailman/listinfo/roundtable
Dan Martin GP Hospital Practitioner Computer Scientist ummar143@shaw.ca (204) 831-1746 answering machine always on
I mean to grab the page the frame references, instead of having Watir figure it out.
I'm just trying to think what I'd do with Mech, as I've never heard of Watir until now.
Sean
On Tue, Apr 20, 2010 at 1:20 PM, Dan Martin ummar143@shaw.ca wrote:
interesting - I get an "unknown frame exception" instead of an "unknown object exception" using locate.
browser.frame("main").locate()
Watir::Exception::UnknownFrameException: Unable to locate a frame using name and main. from /Library/Ruby/Gems/1.8/gems/firewatir-1.6.5/lib/firewatir/elements/frame.rb:29:in `locate' from (irb):66
browser.frame("main").locate_frame(:name, 'main')
Watir::Exception::UnknownObjectException: Unable to locate element, using :name, "main" from /Library/Ruby/Gems/1.8/gems/firewatir-1.6.5/lib/firewatir/element.rb:907:in `assert_exists' from /Library/Ruby/Gems/1.8/gems/firewatir-1.6.5/lib/firewatir/element.rb:1266:in `method_missing' from (irb):64
How would I open the frame directly? The frame I want has an ID, even this doesn't help.
An Xpath search fails:
browser.element_by_xpath('//*[@id="main_ID"]')
=> #<FireWatir::Link:0x1a7fdcc located=false how=:jssh_name what=nil>
On 20-Apr-10, at 12:35 PM, Sean Walberg wrote:
If you RTSL a bit you'll see that calling browser.frame creates a new element but doesn't validate it actually found anything. When you call the html method it first asserts that the object exists and throws an exception if not.
The located=false comes from the element#inspect method, (which just taught me a new Ruby idiom: !!@o returns true if @o is a valid object or false if it isn't.) So located=false means that the object never existed, nor will it ever.
While poking around I saw a locate_frame method. Maybe that might work better? (It's actually possible that .frame uses locate_frame, I didn't trace it far enough)
Failing that, what about opening the frame directly?
Sean
On Tue, Apr 20, 2010 at 12:05 PM, Dan Martin ummar143@shaw.ca wrote:
As noted in the previous email
browser.frame("main")
=> #<FireWatir::Frame:0x1a90dd4 located=false how=:name what="main">
"located=false" seems to be Firewatir's way of saying that the object doesn't exist until I ask for it. If I try to use it anyway, I get an unknown object exception
browser.frame("main").html
Watir::Exception::UnknownObjectException: Unable to locate element, using :name, "main" from /Library/Ruby/Gems/1.8/gems/firewatir-1.6.5/lib/firewatir/element.rb:907:in `assert_exists' from /Library/Ruby/Gems/1.8/gems/firewatir-1.6.5/lib/firewatir/elements/frame.rb:34:in `html' from (irb):62
On 20-Apr-10, at 11:34 AM, Sean Walberg wrote:
Looking at the rdocs, http://wtr.rubyforge.org/rdoc/1.6.5/, have you tried
browser.frame("main").html
?
On Tue, Apr 20, 2010 at 10:51 AM, Dan Martin ummar143@shaw.ca wrote:
I am learning to navigate and scrape. I have had more success with Firewatir than Ruby mechanize, but both are poorly documented.
Current problem: logging into a site webpage, Firwatir can see the frames, but cannot access them.
browser.show_frames
There are 3 frames frame: name: topbar index: 1 frame: name: langFrame index: 2 frame: name: main index: 3 => 0..2
browser.frame(:index, 1)
=> #<FireWatir::Frame:0x1a9260c located=false how=:index what=1>
browser.frame("main")
=> #<FireWatir::Frame:0x1a90dd4 located=false how=:name what="main">
Firefox shows the webpage source [I show only the top levels] structure as:
<html>
<head> <meta http-equiv="content-type" content="text/html;charset=iso-8859-1"> <title>TITLE</title> <link rel="stylesheet" href="all.css">
<script language="JavaScript" src="WEBPAGE"></script> <script language="JavaScript">FUNCTIONS</script></head>
<frameset rows="63,0,*" border="0" id="frameset_ID"framespacing="0" frameborder="no" onload="loadHomepage(1);" onunload="forceLogout();"> <frame src="/TDM/header.htm" name="topbar" scrolling="no" noresize>STUFF IN HERE</frame>
<frame name="langFrame" src="lang.html">STUFF INHERE</frame> <frame src="" id="main_ID" name="main" noresize>STUFF IN HERE THAT I WANT</frame> </frameset>
<noframes> STUFF IN HERE </noframes></html>
I cannot access any forms etc included in the frame unless I can name / access the frame. Any ideas?
Dan Martin GP Hospital Practitioner Computer Scientist ummar143@shaw.ca (204) 831-1746 answering machine always on
Roundtable mailing list Roundtable@muug.mb.ca http://www.muug.mb.ca/mailman/listinfo/roundtable
-- Sean Walberg sean@ertw.com http://ertw.com/ _______________________________________________ Roundtable mailing list Roundtable@muug.mb.ca http://www.muug.mb.ca/mailman/listinfo/roundtable
Dan Martin GP Hospital Practitioner Computer Scientist ummar143@shaw.ca (204) 831-1746 answering machine always on
Roundtable mailing list Roundtable@muug.mb.ca http://www.muug.mb.ca/mailman/listinfo/roundtable
-- Sean Walberg sean@ertw.com http://ertw.com/ _______________________________________________ Roundtable mailing list Roundtable@muug.mb.ca http://www.muug.mb.ca/mailman/listinfo/roundtable
Dan Martin GP Hospital Practitioner Computer Scientist ummar143@shaw.ca (204) 831-1746 answering machine always on
Roundtable mailing list Roundtable@muug.mb.ca http://www.muug.mb.ca/mailman/listinfo/roundtable
I used a web page reference - consisting of variables enbedded in a URL - to "goto" the frame directly. I can fill the login fields and click the button, but then I'm sent to another web page which is completely blank.
I may have to skip the login altogether, and do it manually. Hopefully I can still navigate within the web site.
It wouldn't surprise me if the difficulty getting in is intentional - to discourage robots from guessing names and passwords. But I had no trouble automating my access to a different financial institution's site.
On 20-Apr-10, at 1:26 PM, Sean Walberg wrote:
I mean to grab the page the frame references, instead of having Watir figure it out.
I'm just trying to think what I'd do with Mech, as I've never heard of Watir until now.
Sean
On Tue, Apr 20, 2010 at 1:20 PM, Dan Martin ummar143@shaw.ca wrote: interesting - I get an "unknown frame exception" instead of an "unknown object exception" using locate.
browser.frame("main").locate()
Watir::Exception::UnknownFrameException: Unable to locate a frame using name and main. from /Library/Ruby/Gems/1.8/gems/firewatir-1.6.5/lib/firewatir/ elements/frame.rb:29:in `locate' from (irb):66
browser.frame("main").locate_frame(:name, 'main')
Watir::Exception::UnknownObjectException: Unable to locate element, using :name, "main" from /Library/Ruby/Gems/1.8/gems/firewatir-1.6.5/lib/firewatir/ element.rb:907:in `assert_exists' from /Library/Ruby/Gems/1.8/gems/firewatir-1.6.5/lib/firewatir/ element.rb:1266:in `method_missing' from (irb):64
How would I open the frame directly? The frame I want has an ID, even this doesn't help.
An Xpath search fails:
browser.element_by_xpath('//*[@id="main_ID"]')
=> #<FireWatir::Link:0x1a7fdcc located=false how=:jssh_name what=nil>
On 20-Apr-10, at 12:35 PM, Sean Walberg wrote:
If you RTSL a bit you'll see that calling browser.frame creates a new element but doesn't validate it actually found anything. When you call the html method it first asserts that the object exists and throws an exception if not.
The located=false comes from the element#inspect method, (which just taught me a new Ruby idiom: !!@o returns true if @o is a valid object or false if it isn't.) So located=false means that the object never existed, nor will it ever.
While poking around I saw a locate_frame method. Maybe that might work better? (It's actually possible that .frame uses locate_frame, I didn't trace it far enough)
Failing that, what about opening the frame directly?
Sean
On Tue, Apr 20, 2010 at 12:05 PM, Dan Martin ummar143@shaw.ca wrote: As noted in the previous email
browser.frame("main")
=> #<FireWatir::Frame:0x1a90dd4 located=false how=:name what="main">
"located=false" seems to be Firewatir's way of saying that the object doesn't exist until I ask for it. If I try to use it anyway, I get an unknown object exception
browser.frame("main").html
Watir::Exception::UnknownObjectException: Unable to locate element, using :name, "main" from /Library/Ruby/Gems/1.8/gems/firewatir-1.6.5/lib/firewatir/ element.rb:907:in `assert_exists' from /Library/Ruby/Gems/1.8/gems/firewatir-1.6.5/lib/firewatir/ elements/frame.rb:34:in `html' from (irb):62
On 20-Apr-10, at 11:34 AM, Sean Walberg wrote:
Looking at the rdocs, http://wtr.rubyforge.org/rdoc/1.6.5/, have you tried
browser.frame("main").html
?
On Tue, Apr 20, 2010 at 10:51 AM, Dan Martin ummar143@shaw.ca wrote: I am learning to navigate and scrape. I have had more success with Firewatir than Ruby mechanize, but both are poorly documented.
Current problem: logging into a site webpage, Firwatir can see the frames, but cannot access them.
browser.show_frames
There are 3 frames frame: name: topbar index: 1 frame: name: langFrame index: 2 frame: name: main index: 3 => 0..2
browser.frame(:index, 1)
=> #<FireWatir::Frame:0x1a9260c located=false how=:index what=1>
browser.frame("main")
=> #<FireWatir::Frame:0x1a90dd4 located=false how=:name what="main">
Firefox shows the webpage source [I show only the top levels] structure as:
<html>
<head> <meta http-equiv="content-type" content="text/ html;charset=iso-8859-1"> <title>TITLE</title> <link rel="stylesheet" href="all.css">
<script language="JavaScript" src="WEBPAGE"></script> <script language="JavaScript">FUNCTIONS</script></head>
<frameset rows="63,0,*" border="0" id="frameset_ID"framespacing="0" frameborder="no" onload="loadHomepage(1);" onunload="forceLogout();"> <frame src="/TDM/header.htm" name="topbar" scrolling="no" noresize>STUFF IN HERE</frame>
<frame name="langFrame" src="lang.html">STUFF INHERE</frame> <frame src="" id="main_ID" name="main" noresize>STUFF IN HERE THAT I WANT</frame> </frameset>
<noframes> STUFF IN HERE </noframes></html>
I cannot access any forms etc included in the frame unless I can name / access the frame. Any ideas?
Dan Martin GP Hospital Practitioner Computer Scientist ummar143@shaw.ca (204) 831-1746 answering machine always on
Roundtable mailing list Roundtable@muug.mb.ca http://www.muug.mb.ca/mailman/listinfo/roundtable
-- Sean Walberg sean@ertw.com http://ertw.com/ _______________________________________________ Roundtable mailing list Roundtable@muug.mb.ca http://www.muug.mb.ca/mailman/listinfo/roundtable
Dan Martin GP Hospital Practitioner Computer Scientist ummar143@shaw.ca (204) 831-1746 answering machine always on
Roundtable mailing list Roundtable@muug.mb.ca http://www.muug.mb.ca/mailman/listinfo/roundtable
-- Sean Walberg sean@ertw.com http://ertw.com/ _______________________________________________ Roundtable mailing list Roundtable@muug.mb.ca http://www.muug.mb.ca/mailman/listinfo/roundtable
Dan Martin GP Hospital Practitioner Computer Scientist ummar143@shaw.ca (204) 831-1746 answering machine always on
Roundtable mailing list Roundtable@muug.mb.ca http://www.muug.mb.ca/mailman/listinfo/roundtable
-- Sean Walberg sean@ertw.com http://ertw.com/ _______________________________________________ Roundtable mailing list Roundtable@muug.mb.ca http://www.muug.mb.ca/mailman/listinfo/roundtable
Dan Martin GP Hospital Practitioner Computer Scientist ummar143@shaw.ca (204) 831-1746 answering machine always on
There might be some session cookies or some javascript-fu going on that you have to work around. If you're logging in, I'd be betting on the former.
Sean
On Tue, Apr 20, 2010 at 2:28 PM, Dan Martin ummar143@shaw.ca wrote:
I used a web page reference - consisting of variables enbedded in a URL - to "goto" the frame directly. I can fill the login fields and click the button, but then I'm sent to another web page which is completely blank.
I may have to skip the login altogether, and do it manually. Hopefully I can still navigate within the web site.
It wouldn't surprise me if the difficulty getting in is intentional - to discourage robots from guessing names and passwords. But I had no trouble automating my access to a different financial institution's site.
On 20-Apr-10, at 1:26 PM, Sean Walberg wrote:
I mean to grab the page the frame references, instead of having Watir figure it out.
I'm just trying to think what I'd do with Mech, as I've never heard of Watir until now.
Sean
On Tue, Apr 20, 2010 at 1:20 PM, Dan Martin ummar143@shaw.ca wrote:
interesting - I get an "unknown frame exception" instead of an "unknown object exception" using locate.
browser.frame("main").locate()
Watir::Exception::UnknownFrameException: Unable to locate a frame using name and main. from /Library/Ruby/Gems/1.8/gems/firewatir-1.6.5/lib/firewatir/elements/frame.rb:29:in `locate' from (irb):66
browser.frame("main").locate_frame(:name, 'main')
Watir::Exception::UnknownObjectException: Unable to locate element, using :name, "main" from /Library/Ruby/Gems/1.8/gems/firewatir-1.6.5/lib/firewatir/element.rb:907:in `assert_exists' from /Library/Ruby/Gems/1.8/gems/firewatir-1.6.5/lib/firewatir/element.rb:1266:in `method_missing' from (irb):64
How would I open the frame directly? The frame I want has an ID, even this doesn't help.
An Xpath search fails:
browser.element_by_xpath('//*[@id="main_ID"]')
=> #<FireWatir::Link:0x1a7fdcc located=false how=:jssh_name what=nil>
On 20-Apr-10, at 12:35 PM, Sean Walberg wrote:
If you RTSL a bit you'll see that calling browser.frame creates a new element but doesn't validate it actually found anything. When you call the html method it first asserts that the object exists and throws an exception if not.
The located=false comes from the element#inspect method, (which just taught me a new Ruby idiom: !!@o returns true if @o is a valid object or false if it isn't.) So located=false means that the object never existed, nor will it ever.
While poking around I saw a locate_frame method. Maybe that might work better? (It's actually possible that .frame uses locate_frame, I didn't trace it far enough)
Failing that, what about opening the frame directly?
Sean
On Tue, Apr 20, 2010 at 12:05 PM, Dan Martin ummar143@shaw.ca wrote:
As noted in the previous email
browser.frame("main")
=> #<FireWatir::Frame:0x1a90dd4 located=false how=:name what="main">
"located=false" seems to be Firewatir's way of saying that the object doesn't exist until I ask for it. If I try to use it anyway, I get an unknown object exception
browser.frame("main").html
Watir::Exception::UnknownObjectException: Unable to locate element, using :name, "main" from /Library/Ruby/Gems/1.8/gems/firewatir-1.6.5/lib/firewatir/element.rb:907:in `assert_exists' from /Library/Ruby/Gems/1.8/gems/firewatir-1.6.5/lib/firewatir/elements/frame.rb:34:in `html' from (irb):62
On 20-Apr-10, at 11:34 AM, Sean Walberg wrote:
Looking at the rdocs, http://wtr.rubyforge.org/rdoc/1.6.5/, have you tried
browser.frame("main").html
?
On Tue, Apr 20, 2010 at 10:51 AM, Dan Martin ummar143@shaw.ca wrote:
I am learning to navigate and scrape. I have had more success with Firewatir than Ruby mechanize, but both are poorly documented.
Current problem: logging into a site webpage, Firwatir can see the frames, but cannot access them.
browser.show_frames
There are 3 frames frame: name: topbar index: 1 frame: name: langFrame index: 2 frame: name: main index: 3 => 0..2
browser.frame(:index, 1)
=> #<FireWatir::Frame:0x1a9260c located=false how=:index what=1>
browser.frame("main")
=> #<FireWatir::Frame:0x1a90dd4 located=false how=:name what="main">
Firefox shows the webpage source [I show only the top levels] structure as:
<html>
<head> <meta http-equiv="content-type" content="text/html;charset=iso-8859-1"> <title>TITLE</title> <link rel="stylesheet" href="all.css">
<script language="JavaScript" src="WEBPAGE"></script> <script language="JavaScript">FUNCTIONS</script></head>
<frameset rows="63,0,*" border="0" id="frameset_ID"framespacing="0" frameborder="no" onload="loadHomepage(1);" onunload="forceLogout();"> <frame src="/TDM/header.htm" name="topbar" scrolling="no" noresize>STUFF IN HERE</frame>
<frame name="langFrame" src="lang.html">STUFF INHERE</frame> <frame src="" id="main_ID" name="main" noresize>STUFF IN HERE THAT I WANT</frame> </frameset>
<noframes> STUFF IN HERE </noframes></html>
I cannot access any forms etc included in the frame unless I can name / access the frame. Any ideas?
Dan Martin GP Hospital Practitioner Computer Scientist ummar143@shaw.ca (204) 831-1746 answering machine always on
Roundtable mailing list Roundtable@muug.mb.ca http://www.muug.mb.ca/mailman/listinfo/roundtable
-- Sean Walberg sean@ertw.com http://ertw.com/ _______________________________________________ Roundtable mailing list Roundtable@muug.mb.ca http://www.muug.mb.ca/mailman/listinfo/roundtable
Dan Martin GP Hospital Practitioner Computer Scientist ummar143@shaw.ca (204) 831-1746 answering machine always on
Roundtable mailing list Roundtable@muug.mb.ca http://www.muug.mb.ca/mailman/listinfo/roundtable
-- Sean Walberg sean@ertw.com http://ertw.com/ _______________________________________________ Roundtable mailing list Roundtable@muug.mb.ca http://www.muug.mb.ca/mailman/listinfo/roundtable
Dan Martin GP Hospital Practitioner Computer Scientist ummar143@shaw.ca (204) 831-1746 answering machine always on
Roundtable mailing list Roundtable@muug.mb.ca http://www.muug.mb.ca/mailman/listinfo/roundtable
-- Sean Walberg sean@ertw.com http://ertw.com/ _______________________________________________ Roundtable mailing list Roundtable@muug.mb.ca http://www.muug.mb.ca/mailman/listinfo/roundtable
Dan Martin GP Hospital Practitioner Computer Scientist ummar143@shaw.ca (204) 831-1746 answering machine always on
Roundtable mailing list Roundtable@muug.mb.ca http://www.muug.mb.ca/mailman/listinfo/roundtable
I am considering adding eSATA and external toasters to my Mac Pro, in order to maximize swapability but maintain speed. I am thinking of making my next machine entirely eSATA / toasters, with no internal drives.
Is there any major downside to doing this? I am assuming that I can hot swap on any *nix system (aside from the boot drive) and that the speed will be only minimally slower than internal SATA, and still faster than my drives. I am assuming that the drives will run quietly and cool in toasters, and that my cat won't chew the cables.
Am I missing any obvious problems here?
Dan Martin GP Hospital Practitioner Computer Scientist ummar143@shaw.ca (204) 831-1746 answering machine always on
The eSATA speed should, all other things being equal, be identical to internal SATA.
Beware that unless your ports are explicitly eSATA, they likely won't handle hot plugging properly. (i.e. You can connect your onboard SATA ports to eSATA adapter brackets - and this will generally work - but they don't magically support all the "e" aspects unless designed to do so; some are, some aren't.)
Also if you want to use any kind of multi-bay enclosure, the host ports must explicitly support SATA Multipliers (multiplexers?) or you won't be able to access any of the drives in that enclosure reliably.
-Adam
-----Original Message----- From: Dan Martin ummar143@shaw.ca Date: Mon, 31 May 2010 21:15:09 To: MUUG roundtableroundtable@muug.mb.ca Subject: [RndTbl] eSATA
I am considering adding eSATA and external toasters to my Mac Pro, in order to maximize swapability but maintain speed. I am thinking of making my next machine entirely eSATA / toasters, with no internal drives.
Is there any major downside to doing this? I am assuming that I can hot swap on any *nix system (aside from the boot drive) and that the speed will be only minimally slower than internal SATA, and still faster than my drives. I am assuming that the drives will run quietly and cool in toasters, and that my cat won't chew the cables.
Am I missing any obvious problems here?
Dan Martin GP Hospital Practitioner Computer Scientist ummar143@shaw.ca (204) 831-1746 answering machine always on
_______________________________________________ Roundtable mailing list Roundtable@muug.mb.ca http://www.muug.mb.ca/mailman/listinfo/roundtable
On 2010-05-31 Dan Martin wrote:
I am assuming that the drives will run quietly and cool in toasters, and that my cat won't chew the cables.
I wouldn't do it for a few reasons:
1. If they are 3.5 external they will require their own power bricks, and that's way less energy efficient than using a good internal APFC power supply. If they are 2.5 they will probably draw power from the bus, which would be ok. But 2.5 you have to make sure you get >= 7200 rpm to get good performance.
2. Most external drives and enclosures are not cooled adequately and when they are, their tiny little fans die all the time. If it's 2.5 you're going for, it's not as big a deal, but 3.5 will require normal cooling which is just plain hard to do in small (single drive) enclosures.
3. Things will bump the enclosure and your drives won't live as long.
4. Cable clutter.
-
Adam Thompson -
Dan Martin -
Gilbert E. Detillieux -
Sean Walberg -
Trevor Cordes