[Date Prev][Date
Next][Thread Prev][Thread Next][Date
Index][Thread Index]
Re: Automatic TV listings: Was RE: http://zz9.dnsq.org
>from
anyway, and quite possibly in XML format - should be easy for them to do
it,
but...if they want to is another matter (sort of short circuits their
business).
I'm all up for the XML format though.
> I've been pondering this as well. I've got a version that
screenscrapes
> from Digiguide, but I'm also concerned about being spotted in the
> logs...
If you are worried about screenscrpaing and being noticed, you should be
able to tweak your script that downloads the web pages from Digiguide's to
make it look like a normal web browser by changing the HTTP_USER_AGENT
fields to rename it to IE6 or whatever - that way there is no immediately
obvious info added to the log.
-Dan
Home |
Main Index |
Thread Index
|