Comments on: Django vs feedparser on dates

By: Rafael

Rafael — Wed, 10 Dec 2008 21:46:26 +0000

Hi! I’ve got the same problem with 1-hour-delay, you just have to use your timezone:
import datetime, time

datetime.datetime(2004, 11, 19, 5, 13, 31) + datetime.timedelta(seconds=time.timezone)

By: Fazal Majid

Fazal Majid — Sun, 16 Sep 2007 12:14:12 +0000

Keep in mind the DST bug could well be in the feed generator. Quite a few will blithely assume UTC = Local Time +/- offset and not factor in DST.

I have often seen feeds with timestamps 1 hour into the future, and added logic to my aggregator, Temboz, to automatically substract 1 hour if it detects this:

http://www.temboz.com/temboz/fileview?f=temboz/normalize.py

By: Doug Hellmann

Doug Hellmann — Mon, 03 Sep 2007 09:18:30 +0000

If you're building an aggregator, you might want to have a look at feedcache. When combined with shove, it makes managing feeds for aggregators very easy.

By: garth

garth — Sun, 02 Sep 2007 23:55:50 +0000

Testing translation methods against 195 timestamps... _ludo: 0 _devex: 0 _kiopi: 0 _anders: 0 _gt: 0 _sam_and_zeb: 0 _garth: 4

All the methods work, except the one I got from the Django community blog. Oops.

Now I’ll have to collect raw timestamps so I can check dateutil versus feedburner…

By: mikeal

mikeal — Sun, 02 Sep 2007 21:38:25 +0000

I think i ended up scratching the use of the feedparser _parsed attributes all together. The parsing code there just isn’t as robust and dateutil.parser.parse().

For what it’s worth I’ve never had problems with dateutil’s parsing code, especially for ISO8601 parsing which is usually what feeds use.

By: Sam Ruby

Sam Ruby — Sun, 02 Sep 2007 15:26:48 +0000

datetime.datetime.utcfromtimestamp(calendar.timegm(feedparser_timestamp))

By: Sam Ruby

Sam Ruby — Sun, 02 Sep 2007 15:22:41 +0000

Dealing With Dates…

Simon Willison: Django vs feedparser on dates. Some useful tips in the comments. I find Python’s timezone stuff endlessly frustrating: I know it can do what I want, but it always take…

By: Zebziggle

Zebziggle — Sun, 02 Sep 2007 13:04:36 +0000

Try again with formatting …

if hasattr(content, 'modified') and \ content.modified != None: feed.lastModified = \ datetime.datetime.utcfromtimestamp( calendar.timegm(content.modified))

By: Zebziggle

Zebziggle — Sun, 02 Sep 2007 13:02:59 +0000

Mine looks like this:

if hasattr(content, 'modified') and content.modified != None: feed.lastModified = datetime.datetime.utcfromtimestamp(calendar.timegm(content.modified))

By: ludo

ludo — Sun, 02 Sep 2007 10:58:32 +0000

garth, utc should be pytz.UTC