NFPS xmltv EPG Grabber development

Status
Not open for further replies.
#402
hi Dar,

I thought the same was going on so I did a cmd line pull on dish sat and can see data for ex 300 HBO.
I dunno why grabber aint workin.

Code: 
<channel id="I300.28458538.microsoft.com">
		<display-name>HBO</display-name>
		<display-name>300 HBO</display-name>
		<display-name>300</display-name>
Code: 
<programme start="20150712220000 -0300" stop="20150712230000 -0300" channel="I300.28458538.microsoft.com">
		<title lang="en">True Detective</title>
		<sub-title lang="en">Down Will Come</sub-title>
		<desc lang="en">The detail works a pawn shop lead to close in on a suspect in the Caspere case; Frank revisits his past.</desc>
		<credits>
			<actor>Colin Farrell</actor>
			<actor>Vince Vaughn</actor>
			<actor>Rachel McAdams</actor>
			<actor>Taylor Kitsch</actor>
			<actor>Kelly Reilly</actor>
			<actor>Christopher James Baker</actor>
			<actor>Afemo Omilami</actor>
			<actor>Chris Kerson</actor>
			<actor>James Frain</actor>
		</credits>
		<date>20150712</date>
		<category lang="en">Drama</category>
		<category lang="en">Episodic</category>
		<category lang="en">Series</category>
		<episode-num system="onscreen">12</episode-num>
		<episode-num system="ms_progid">1.EP018142250013</episode-num>
		<episode-num system="dd_progid">EP01814225.0013</episode-num>
		<audio>
			<stereo>stereo</stereo>
		</audio>
		<new />
		<subtitles type="teletext" />
		<rating system="VCHIP">
			<value>TV-MA</value>
		</rating>
		<rating system="advisory">
			<value>Adult Situations</value>
		</rating>
		<rating system="advisory">
			<value>Language</value>
		</rating>
		<rating system="advisory">
			<value>Violence</value>
		</rating>
	</programme>
	<programme start="20150712230000 -0300" stop="20150712233000 -0300" channel="I300.28458538.microsoft.com">
		<title lang="en">Ballers</title>
		<sub-title lang="en">Heads Will Roll</sub-title>
		<desc lang="en">Spencer visits a neurologist; Charles is pursued by a woman; Joe breaks the rules to get a client; Ricky finds himself a mantra; Reggie tries to hijack Vernon's renegotiation.</desc>
		<credits>
			<actor>Dwayne Johnson</actor>
			<actor>Rob Corddry</actor>
			<actor>Omar Benson Miller</actor>
			<actor>John David Washington</actor>
			<actor>Donovan Carter</actor>
			<actor>Troy Garity</actor>
			<actor>Jazmyn Simon</actor>
			<actor>Arielle Kebbel</actor>
		</credits>
		<date>20150712</date>
		<category lang="en">Comedy</category>
		<category lang="en">Episodic</category>
		<category lang="en">Series</category>
		<episode-num system="onscreen">04</episode-num>
		<episode-num system="ms_progid">1.EP021656140004</episode-num>
		<episode-num system="dd_progid">EP02165614.0004</episode-num>
		<audio>
			<stereo>stereo</stereo>
		</audio>
		<new />
		<subtitles type="teletext" />
		<rating system="VCHIP">
			<value>TV-MA</value>
		</rating>
	</programme>

compared channel names in .ren file and looks good.
 
#404
Did some research and there was a big change in the sourcing for the data:

Code: 
http://www.avsforum.com/forum/26-home-theater-computers/2058850-big-wmc-guide-changes-starting-today.html

We might not have data for a while.
 
#405
hi Dara,Pyscon

I was able to get most data back by switching the ones that were not pulling any data from Microsoft to schedule direct.
get a 7 day trail for signing up.only problem with that is schedule direct only allows up to add 4 pulls,i needed 1 more to get all the missing ones.
got data for all the channels I watch so works for me.
 
#407
@Blackbear199, what providers/zips did you use for schedulesdirect?
Sorry for going off topic, but trying to get my own guide going till things smooth over.

I used DISH for most of the US channels but I have no clue what to use for the UK ones.
 
#408
don't edit the uk ones in the go.bat file.leave them as is and it will pull data from Microsoft.
here's ones I edited
Code: 
Echo Loading PBS
mc2xml -I dummyparsed.xml -C wisc.chl -R wisc.ren -o wisc.xml -D wisc.dat -F -s -2 -u -a -T user:pass

Echo Loading Canadian Lineup
mc2xml -I wisc.xml -R ca.ren  -o ca.xml -D ca.dat -F -s -5 -C ca.chl -u -a -T user:pass

Echo Loading DTV
mc2xml -R dtv.ren -o dtv.xml -D dtv.dat -I ca.xml -F -C dtv.chl -s -5 -u -a -T user:pass

Echo Loading US
mc2xml -R us.ren -I mia.xml -o US.xml -D US.dat -F -C US.chl -s -5 -u -a -T user:pass

replace user:pass with ur schedule direct info
delete or rename the .dat files in the bin folder for the above

in your schedule direct account,click add lineup.here are the ones I use,enter the zip/postalcode and the go by the description to find the right one.

T5J 2B2 Edmonton, CA TELUS Optik TV - Digital CableDigital <-----ca.dat
10001 USA, US DISH Network - Satellite Satellite <--------us.dat
10000 USA, US DIRECTV - Satellite Satellite <---------dtv.dat
53532 Madison, US Charter Communications - Digital <-------wisc.dat
when u run it first time u will get a popup for each of the above from mc2xml,just select ok,all the settings are already there.it will save the new .dat file.after that it will run through without asking anymore.
 
Last edited:
#409
also I only edited the English section as I only use NFPSE.xml

while reading on mc2xml they have this posted on their site.the changes only affect north America data,thats why uk,Ireland,ect will still update pulling from Microsoft.

Code: 
Microsoft has switched their EPG provider for their North American listings from Zap2It to Rovi and have not updated their legacy service (listings run out on 7/26). It is not known if this is temporary or not. The service continues to update listings for other countries.
 
Last edited:
#410
Blackbear199 said:
hi Dara,Pyscon

I was able to get most data back by switching the ones that were not pulling any data from Microsoft to schedule direct.
get a 7 day trail for signing up.only problem with that is schedule direct only allows up to add 4 pulls,i needed 1 more to get all the missing ones.
got data for all the channels I watch so works for me.
Click to expand...

Yeah, aware about them, but still trying to figure out a non-subscription way of doing this. zap2xml probably won't work as you can't easily change the channel names to match to those of the server. I'm going to run a test of webgrab++, configured many of the US channels through there, but I know it will take forever to run it... we'll see how long.
 
#411
I forgot to mention that schedule direct by default give 7 day epg,I changed the other lines to match that pull from Microsoft.
in the mc2xml line you will see -d 48,add that to the above edited lines if u want it to only get the same amount of data from schedule direct.
-d 48 means 48 hrs.
 
#412
This is a quick fix... don't bust me up if it doesn't work! LOL.

Attached is a updated Webgrab config file with as many of the US channels that I could currently find. They are from tvguide, but they don't like their epg from getting grabbed, so be aware of this... don't run this every day. The additional channels will make this webgrab run for about an hour. I didn't check to see if the programs need to be time corrected completely, but apparently they do match up.

I don't expect this to make the is.gd right away , unless psycon sees it. This is for you who roll your own!

Hint ... bypass the generation of US data by the mc2xml grabber... if you don't, those channel assignments will overwrite the webgrabed schedules.
 
Last edited:
#414
Thanks Dara, but, i hate webgrab. lol so damn slow.. i just switched the mc2xml US pull to grab from schedules direct instead of microsoft legacy.. may have a handful less channels but is updating the git now. if someone wants to be a gent and donate an account for schedules direct that would be super.. its $6 for 2 months, or $25 for a year. otherwise my free trial ends in a week.
 
Last edited:
#415
List of English channels that currently do not have EPG data.
Code: 
5 ABC Miami
7 NBC MIami
8 Fox Miami
121 H2 USA
196 Travel
207 CNBC World
211 BBC World News
245 Ovation
314 StarMax
316 ThrillerMax East
324 Showtime Next
408 MSG
418 Astro SuperSport
419 Astro SuperSport 2
420 Astro SuperSport 3
421 Yes Network
 
#416
added blackbear199's update.. thanks you..

also you dont really need to modify the script once the .dat files from a scheduled direct pull have been put in your bin folder, it will use the credentials whatever login was used to create the dat files.. (meaning you may want to remove that attachment if you care,, i dont really care and will be sharing the dat files once I/someone pays for an account)

looks like we may need more than one schedules direct account, likely just 2, to get all the US/Canada channels... still looking for donators for that..
 
Last edited:
#417
Here's a heavily modified version of Pyscon's and all others who contributed grabber.Thanks You.
Its a English only pull.
I removed things like the 20 or so music channels,adult 1,2,3,ect,sports 1,2,3,ect.from start to the few sport channels under sky movies pretty much all channels are there.left the few adult like venus,juicy,ect that are at the end of that section.this only affect what you see in epg,all channels are still selectable if you select channels list.This only affects what you see in epg.
I wanted a nice clean guide for what I watch the most.
I totally removed the webgrab part.
for some reason 5 Starmax has no epg info on schedule direct so I added a dummy channel so it will show in the guide but there's no epg.
Sky Premiere is doing the same for me it its added as a dummy channel also.i'm almost sure it had epg before.

here's my schedule direct I use,i only use 2 now.
Code: 
10001 USA, US DISH Network - Satellite Satellite 
33101 Miami, US DIRECTV Miami - Satellite Satellite
first run for US channels select schedule direct and enter ur schedule direct user/pass.

The thing I like the most is it does the entire pull in less than a minute now.
Have fun and thanks again to Pyscon,Dara and all other who help create this.

Blkbr.

BTW.A current NFPSE.xml is included(ran today).everything is 7 day epg and come in just under 30MB.
 
Last edited:
#418
Thanks.. may actually start hosting something like this as well as I want one without dummies as well.. can you do me a favor and make one with all the channels we have guide data for... that is, do not include any dummies AT ALL, just all the channels with data..

Consider me AFK for the next 2 weeks.. its time for Shambhala.
 
#420
Fix to show Setanta Sports in guide.

edit channelsie.chl

remove/edit Setanta Sports to
#----Senanta Sports
I423.753280.microsoft.com

channelsie.ren
remove/edit Setanta Sports:Setanta Sports to
#----Setanta Sports
I423.753280.microsoft.com:Setanta Sports
---------------------------------------------------------------------------------------
Fix to add True Movies 2 to guide,its added as dummy.no epg from Microsoft.

edit channelsuk.chl

edit True Movies 2 to
#-----True Movies 2
TRUE_MOV.iptvprivateserver.tv

edit channelsuk.ren
edit True Movies 2:True Movies 2 to
#-----True Movies 2
TRUE_MOV.iptvprivateserver.tv:True Movies 2

open dummyeng.body and add this to it
Code: 
<channel id="TRUE_MOV.iptvprivateserver.tv">
		<display-name>True Movies 2</display-name>
	</channel>
	<programme start="20150513213000 +0000" stop="20160513220000 +0000" channel="TRUE_MOV.iptvprivateserver.tv">
		<title lang="en">True Movies 2</title>
		<desc lang="en">True Movies 2 Available Here.</desc>
		<category lang="en">Movie</category>
		<previously-shown />
		<rating system="VCHIP">
			<value>TV-Y</value>
		</rating>
	</programme>
 
Last edited:
Status
Not open for further replies.
Top Bottom
Back
Menu