Comments on: Python File Read Write with Urllib2 http://www.techniqal.com/blog/2008/07/31/python-file-read-write-with-urllib2/ Software > Technology > Programming for Non-Engineers Mon, 02 Jan 2012 20:16:23 +0000 hourly 1 http://wordpress.org/?v=3.3.1 By: Daisy http://www.techniqal.com/blog/2008/07/31/python-file-read-write-with-urllib2/comment-page-1/#comment-11861 Daisy Sat, 02 Apr 2011 11:51:56 +0000 http://www.techniqal.com/blog/2008/07/31/python-file-read-write-with-urllib2/#comment-11861 Thank you for this post, it is really helpful for me as a beginner with python. I wonder how could we use it to download videos say from youtube. Any Ideas. Thank you for this post, it is really helpful for me as a beginner with python. I wonder how could we use it to download videos say from youtube. Any Ideas.

]]> By: Josh Burns http://www.techniqal.com/blog/2008/07/31/python-file-read-write-with-urllib2/comment-page-1/#comment-11837 Josh Burns Fri, 18 Mar 2011 19:13:22 +0000 http://www.techniqal.com/blog/2008/07/31/python-file-read-write-with-urllib2/#comment-11837 This is also a great introduction for someone to hit the ground running using Python in an applicable manner. Have you ever messed with multi-threaded processes in Python? In the case you REALLY want to speed some things up.. :-D This is also a great introduction for someone to hit the ground running using Python in an applicable manner. Have you ever messed with multi-threaded processes in Python? In the case you REALLY want to speed some things up.. :-D

]]> By: Daniel http://www.techniqal.com/blog/2008/07/31/python-file-read-write-with-urllib2/comment-page-1/#comment-11467 Daniel Tue, 18 Jan 2011 23:55:07 +0000 http://www.techniqal.com/blog/2008/07/31/python-file-read-write-with-urllib2/#comment-11467 I agree Haroldo. Maybe I'll do a post about how to get the same thing achieved using Python 3. Thanks for checking out my post. UPDATE: I wrote a new post outlining how to do the same thing with Python3. <a href="http://www.techniqal.com/blog/2008/07/31/python-file-read-write-with-urllib2/" rel="nofollow">python-file-read-write-with-urllib2</a> I agree Haroldo. Maybe I’ll do a post about how to get the same thing achieved using Python 3. Thanks for checking out my post.

UPDATE: I wrote a new post outlining how to do the same thing with Python3. python-file-read-write-with-urllib2

]]> By: Haroldo http://www.techniqal.com/blog/2008/07/31/python-file-read-write-with-urllib2/comment-page-1/#comment-11466 Haroldo Tue, 18 Jan 2011 22:51:41 +0000 http://www.techniqal.com/blog/2008/07/31/python-file-read-write-with-urllib2/#comment-11466 Thanks. It's a pity that with python 3, urllib no longer works the same. Thanks. It’s a pity that with python 3, urllib no longer works the same.

]]> By: joe http://www.techniqal.com/blog/2008/07/31/python-file-read-write-with-urllib2/comment-page-1/#comment-11069 joe Fri, 01 Oct 2010 15:10:47 +0000 http://www.techniqal.com/blog/2008/07/31/python-file-read-write-with-urllib2/#comment-11069 this is the perfect post and script helped me more than 3 days of chit-chat on stackoverflow...Thanks you this is the perfect post and script helped me more than 3 days of chit-chat on stackoverflow…Thanks you

]]> By: Alex Clark http://www.techniqal.com/blog/2008/07/31/python-file-read-write-with-urllib2/comment-page-1/#comment-11068 Alex Clark Tue, 28 Sep 2010 17:50:42 +0000 http://www.techniqal.com/blog/2008/07/31/python-file-read-write-with-urllib2/#comment-11068 Whoah daddy, thanks for this! Whoah daddy, thanks for this!

]]> By: Daniel http://www.techniqal.com/blog/2008/07/31/python-file-read-write-with-urllib2/comment-page-1/#comment-11063 Daniel Mon, 13 Sep 2010 15:07:21 +0000 http://www.techniqal.com/blog/2008/07/31/python-file-read-write-with-urllib2/#comment-11063 You need it install a basic auth handler to urlllib 2. There are 2 methods to do that. 1. Detect a 401 error, and send back the appropriate headers. 2. If you know the uri you are logging into you can install it with the appropriate credentials before you call urlopen. Great example here from http://docs.python.org/library/urllib2.html: import urllib2 # Create an OpenerDirector with support for Basic HTTP Authentication... auth_handler = urllib2.HTTPBasicAuthHandler() auth_handler.add_password(realm='PDQ Application', uri='https://mahler:8092/site-updates.py', user='klem', passwd='kadidd!ehopper') opener = urllib2.build_opener(auth_handler) # ...and install it globally so it can be used with urlopen. urllib2.install_opener(opener) urllib2.urlopen('http://www.example.com/login.html') You need it install a basic auth handler to urlllib 2. There are 2 methods to do that.
1. Detect a 401 error, and send back the appropriate headers.
2. If you know the uri you are logging into you can install it with the appropriate credentials before you call urlopen.

Great example here from http://docs.python.org/library/urllib2.html:
import urllib2
# Create an OpenerDirector with support for Basic HTTP Authentication…
auth_handler = urllib2.HTTPBasicAuthHandler()
auth_handler.add_password(realm=’PDQ Application’,
uri=’https://mahler:8092/site-updates.py’,
user=’klem’,
passwd=’kadidd!ehopper’)
opener = urllib2.build_opener(auth_handler)
# …and install it globally so it can be used with urlopen.
urllib2.install_opener(opener)
urllib2.urlopen(‘http://www.example.com/login.html‘)

]]> By: Bast http://www.techniqal.com/blog/2008/07/31/python-file-read-write-with-urllib2/comment-page-1/#comment-11061 Bast Sun, 12 Sep 2010 05:01:01 +0000 http://www.techniqal.com/blog/2008/07/31/python-file-read-write-with-urllib2/#comment-11061 Thanks, how does this work with basic authentication? Thanks, how does this work with basic authentication?

]]> By: Scott Peterson http://www.techniqal.com/blog/2008/07/31/python-file-read-write-with-urllib2/comment-page-1/#comment-10996 Scott Peterson Thu, 13 May 2010 07:16:59 +0000 http://www.techniqal.com/blog/2008/07/31/python-file-read-write-with-urllib2/#comment-10996 Works great. Thank you. Works great. Thank you.

]]> By: Bryce Thomas http://www.techniqal.com/blog/2008/07/31/python-file-read-write-with-urllib2/comment-page-1/#comment-10851 Bryce Thomas Tue, 11 Aug 2009 00:57:13 +0000 http://www.techniqal.com/blog/2008/07/31/python-file-read-write-with-urllib2/#comment-10851 Thanks very much for this script. I've downloaded the google logo based on your example; now I just need to tweak your example a bit to download a series of PDF documents instead of images. Thanks very much for this script. I’ve downloaded the google logo based on your example; now I just need to tweak your example a bit to download a series of PDF documents instead of images.

]]> By: Kmilin http://www.techniqal.com/blog/2008/07/31/python-file-read-write-with-urllib2/comment-page-1/#comment-10844 Kmilin Sat, 20 Jun 2009 20:26:37 +0000 http://www.techniqal.com/blog/2008/07/31/python-file-read-write-with-urllib2/#comment-10844 thanks a lot, it works! now, lets steal some stuff !!!!! XD thanks a lot, it works! now, lets steal some stuff !!!!! XD

]]> By: Daniel http://www.techniqal.com/blog/2008/07/31/python-file-read-write-with-urllib2/comment-page-1/#comment-10700 Daniel Mon, 22 Sep 2008 15:11:52 +0000 http://www.techniqal.com/blog/2008/07/31/python-file-read-write-with-urllib2/#comment-10700 Hey daonb,<br><br>the only reason I could see an issue with large files, is if the socket connection times out.<br>If you see this happening, check out the socket module. You can import it within this function, and set temporary timeout settings. Hey daonb,

the only reason I could see an issue with large files, is if the socket connection times out.
If you see this happening, check out the socket module. You can import it within this function, and set temporary timeout settings.

]]> By: daonb http://www.techniqal.com/blog/2008/07/31/python-file-read-write-with-urllib2/comment-page-1/#comment-10694 daonb Tue, 16 Sep 2008 11:56:52 +0000 http://www.techniqal.com/blog/2008/07/31/python-file-read-write-with-urllib2/#comment-10694 It works! I found your site googling for a "urllib2 loop read". Thanks fro the script won't it have problems with large files? It works! I found your site googling for a “urllib2 loop read”. Thanks fro the script won't it have problems with large files?

]]>