DigiGuide alternative to RT XMLTV

[whibs]

Originally Posted by bunch92

Maybe it is because they have just released a new version (8.4) ?

The thought crossed my mind, but then I figured it was much more likely that I did something wrong. It's reassuring to know that I'm not the only one affected.

Looks like MadAxeMan hasn't been active on this forum since June. I guess for now I shall content myself with the RT grabber. Thanks for your input, bunch92!

[planetc]

Originally Posted by Nick_W

Hi,

Yes, DigiGuide needs to run in the system tray all the time. If some problem should occur with the importer (other than user error) I will fix it (and post here), as this is the method of import I use myself

Regards,

Nick.

Don't give up yet!

[jaminben]

Yep 8.4 broke mine as well I upgraded before I knew anything was wrong and stupidly overwrote my previous install. However I've found a link to the previous version 8.3 and all is working again Even if I have to redo all my channel listings at least it works for the time being

http://www.download3000.com/download...reg-28792.html

[Nick_W]

I'm on it chaps; will be fixed by Monday (assuming it is actually fixable!).

Regards,

Nick.

[jaminben]

Originally Posted by Nick_W

I'm on it chaps; will be fixed by Monday (assuming it is actually fixable!).

Regards,

Nick.

Sweet, Looking forword to it

[whibs]

Excellent!

[planetc]

phew! Just checked my auto update settings and they are set for program listings only.
Nick, you are the man of the moment matey. I raise a glass to you for your efforts.

[Nick_W]

Hi,

Not sure what's happening. On my test machine I've upgraded to 8.4, and I get the same problem as you guys.

However, if I exit DG and then restart it and run DG2XML again, then I do get an epgdata file of ~2.5MB, which looks fine. After ~2.5MB I get the error tough. The whole file is usually ~8MB.

This strikes me as an error in the DG web server, rather than my code. Could you guys try the above and let me know what happens?

TIA,

Nick.

[bunch92]

Same thing as you, DG2XML created a 2.1 Mo file which is incomplete.

It finishes like this :

<programme channel="115" channel2="673" start="20090125044000 +0000" stop="20090125054000 +0000"><title>My 22 Stone Dad and Skinny Me</title><desc>Documentary looking at how seven-stone teenager Emma's eating disorder is linked to her clinically-obese father

[whibs]

Nick_W, like you described, when I first set up the web service and then ran DG2XML, the error occurred straight away.

At the time I thought a restart of DigiGuide was needed, which I duly did. DG2XML got a bit further - up to 8 'retrieving' lines following the 'outputting to epgdata.xml' line.

It has never got further than that point, whether re-running, restarting or rebooting. The resultng epdgata.xml file is around 2.5MB, but is evidently incomplete and the xml is improperly formed as a result.

I've tested the URLs shown in the DG2XML screen output in a browser (without and without the SIDs). To start with I was getting nothing at all, then I was getting an obscure 8 or so digit number. Then I was getting a page full of times, which was the rendering of what appeared in the source to be a 'good' portion of the data with lots of CDATA markup.

Interestingly, I have been able to retrieve data in the browser with 'chi=7' and beyond in these URL tests, which DG2XML apparently fails to do at present.

I know it's a silly question, but is it intentional for the retrieved source to feature CDATA markup? Is this the format expected by DG2XML, or is it expected that the source should be additionally transformed into a more 'complete' format by this stage? Thinking about it, I think I've just answered my own question by observing the correct formatting thus far of epgdata.xml.

Thanks for looking into this - much appreciated.

[Nick_W]

Right, that's not good really. To me it looks like a DG web service problem. My code it outputting the XML correctly, and then for some reason the web service appears to just stop outputting data.

I'm still looking!

Regards,

Nick.

[whibs]

Perhaps a DoS-style constraint has been built in, preventing more than x hits/sec? A sensible precaution when exposing the web service to the internet...

Of course, slowing down the hit rate would drastically increase the extract time, but I planned for this to be run on an overnight weekly schedule - it could run all night if it had to!

[Nick_W]

Hi,

Try attached and let me know. Just directly replace the current file.

Regards,

Nick.

[jaminben]

It certainly grabs more data but not as much as it should do. First attempt I got just over 7mb and the second attempt I got just over 12mb. Normally it gets around 15-16mb.

[Nick_W]

OK, try this one.

[bunch92]

Looks like it worked, I now produce a 23Mo file. If other people can confirm, I will move from tv_grab_uk_rt to your solution.

[jaminben]

Even though the data is smaller than normal it does appear to be working and all epg data has imported fine into Sage
I'll let you know if any issues crop up.

Thankyou Nick

[planetc]

Nice one Nick, I'll upgrade when I have some time on my hands. Hopefully any potential issues will have shown up by then.

[Nick_W]

Originally Posted by jaminben

Even though the data is smaller than normal it does appear to be working and all epg data has imported fine into Sage
I'll let you know if any issues crop up.

Thankyou Nick

If it ends </tv> then it worked. Also I would say DG just put some sort of constraint on it to stop people doing what we are doing!

Regards,

Nick.

[whibs]

Your fix has worked a treat - thanks, Nick_W!

It took about ten minutes to run (retrieving Sky FreeSat channels). I'm just about to run it though StephaneM's importer - looking forward to seeing the end result in the EPG now.

I'm guessing the DG constraint was mainly for the benefit of home users hosting their own web-based guide, which others may seize upon if they knew about it (maliciously or otherwise). I imagine it would be all too easy to reduce a system and internet connection to a crawl without this in place.

Thanks again.