First of all, thank you very much for an excellent product, your work and effort is really appreciated!
I just migrated my setup from TVXB to WebGrab+, partially because TVXB is no longer developed/supported and partly because my TVXB setup "broke" due to changes on the guide pages. I'm currently living in Singapore and I'm using the latest version of WebGrab+ and the lates SiteIni files "starhub.com.en" and "entertainment.xin.msn.com". Here is my WebGrab++.config.xml:
<?xml version="1.0" encoding="utf-8"?> <!-- Configuration file for WebGrab+Plus, the incremental Electronic-Program-Guide web grabber by Jan van Straaten, December 2011 Version V1.1.1 --> <!-- First version customized by chjo 02-01-2014 --> <settings> <!-- filename The path (required) + filename where the epgguide xml file is /will be located. It must include drive and folder. Like C:\ProgramData\ServerCare\WebGrab\guide.xml If the file already exist (from last run or from another xmltv source) it will read it and use what fits the requested output. In that case the file will be updated. If no such file exist it will be created. Change the following to your own needs : --> <filename>C:\ProgramData\ServerCare\WebGrab\guide.xml</filename> <!-- modes: d or debug saves the output xmltv file in a file with -debug addition in the file name . The original xmltv file will be kept. m or measure measures the time for each updated show or new show added n = nomark disables the update-type marking (n) (c) (g) (r) at the end of the description v or verify verifies the result following a channel update w or wget use wget as grab engine (might improve site recognition in rare cases) Note that modes can be added in one line, separated by comma's or spaces, or both. --> <mode>m</mode> <!-- postprocess: Optional , specifies which of the available postprocesses should run. syntax: <postprocess run="" grab="">processname</postprocess> (optional) grab="yes" or "y" or "true" or "on" : grabs epg first (default) ; "no" or "n" or "false" or "off" : skip epg grabbing (optional) run="yes" or "y" or "true" or "on" : runs the postprocess (default) ; "no" or "n" or "false" or "off" : do not run post process processname: the process to run : processname = mdb runs a build in movie database grabber (read / adapt ...\mdb\mdb.confif.xml processname = rex runs a postprocess that re-allocates xmltv elements (read / adapt ...\rex\rex.config.xml) examples: <postprocess run="on" grab="on">mdb</postprocess> grabs first , then run mdb <postprocess>mdb</postprocess> same as above (uses defaults for grab and run) <postprocess grab="no">rex</postprocess> runs rex without grab (existing xmltv file) --> <!-- Commented out by chjo <postprocess run="y" grab="y">mdb</postprocess> --> <!-- proxy: This setting is only required if your computer is connected to internet behind a proxy specify proxy address as ip:port like <proxy>192.168.2.4:8080</proxy> or as <proxy>automatic</proxy> which attempts to read the proxy address from your connection settings. If your proxy requires a username and password, add them like <proxy user="username" password="password">192.168.2.4:8080</proxy> <proxy>192.168.2.2:8080</proxy> --> <proxy>automatic</proxy> <!-- user agent: The user agent string that is sent to the tvguide website. Some sites require this. Valid values are either , in which case the program generates a random string, or any other string like <user-agent>Mozilla/5.0 (Windows; U; MSIE 9.0; WIndows NT 9.0; en-US)</user-agent> <user-agent>random</user-agent><user-agent>Mozilla/5.0 (Windows; U; MSIE 9.0; WIndows NT 9.0; en-US)</user-agent><user-agent>Mozilla/5.0 (Linux; U; Android 0.5; en-us) AppleWebKit/522+ (KHTML, like Gecko) Safari/419.3</user-agent> --> <user-agent>Mozilla/5.0 (compatible; MSIE 9.0; Windows NT 6.1; WOW64; Trident/5.0; yie9)</user-agent> <!-- logging: simply put 'on' in there to start logging, anything else will turn it off --> <logging>on</logging> <!--retry The most simple form of retry defines the amount of times the grabber engine should attempt to capture a web page before giving up and continuing with the next page, like <retry>4</retry> It is also the place to specify delays between retries and the grabbing of html pages with the following attributes: timeout; the delay between retries (default is 10 sec), channel-delay; the delay between subsequent channels (default is 0), index-delay; the delay between the grabbing of index pages (default is 0), show-delay; the delay between the grabbing of detail show pages (default is 0). In the most complete version it will look like this: <retry time-out="5" channel-delay="5" index-delay="1" show-delay="1">4</retry> show-delay="2" --> <retry time-out="5">4</retry> <!--skip It takes two values H,m separated by a comma: The first H : if a show takes more than H hours, it's either tellsell or other commercial fluff, or simply a mistake or error, we want to skip such shows. The second m : if a show is less or equal than m minutes it is probably an announcement , in any case not a real show. When entered as <skip></skip> the defaults are 12 hours, 1 minute, same as <skip>12,1</skip>. To disable this function enter or just leave out this entry completely<skip>14, 1</skip><skip>16,1</skip> --> <skip>noskip</skip> <!--timespan The timespan for which shows will be grabbed. It takes one or two values separated by a comma or a space. The first is the number of days (including today) to download, note that 0 is today. The second (optional) is a time specified between 0:00 and 24:00 which will reduce the download to only the one show (per day) which is scheduled around the specified time. Any value between start time (including) and stop time will do This -one-show-only mode is helpfull if a SiteIni file needs to be debugged --> <timespan>6</timespan> <!-- update mode i or incremental only updates of changes , gabs, repairs and new shows l or light forces update of today and new shows, rest as incremental s or smart forces update of today and tomorrow and new shows, rest as light f or full or force forces full update If one of these values is entered here it will apply to all channels selected for update (see channel). This value overrules the value of 'update' for in the individual channels If no value is entered here the individual 'update' values from the channellist are taken --> <update>f</update> <!-- The channel-list : Each channel to be grabbed has a separate entry in the list, the most common form is: <channel update=.. site=.. site_id=.. xmltv_id=.. >display-name</channel> Besides this form, there is a possibility to specify special channels like 'combi-channels' and 'timeoffset-channels', see further down for more information--> <!-- Channel list files : The easiest way to compose this channel-list is to copy the required channels from the channel-list files which can be found in the SiteIni.Pack for nearly every supported tvguide site. --> <!-- update : The mode values here can be set for each channel differently if not overruled by the general update setting (see above). Allowed values are as the same as the general update setting. Any other value will be ignored. If any of the allowed values of 'update' is entered, this channel will be updated , no value no update ! In that case the epg data of that channel will remain as it is. --> <!-- site: The website to be used to get the EPG from. The value entered here is the name of the .ini file that supplies the specific parameters for the site without .ini extension. e.g tvgids.nl.ini becomes site="tvgids.nl" and gids.publiekeomroep.nl.ini becomes site="gids.publiekeomroep.nl".--> <!-- site_id: This is the number or text used by the site as reference to the correct html page for this channel. It is used by the program to compose the url for the shows for a channel. For nearly all sites supported by the program a channel-list file is provided in the siteini-pack. It list most of the available channels including this site_id --> <!-- xmltv_id : The xmltv_id can be any string that suits your needs, you will find it back as the "channel" in your xml file as in : <programme start="20100218072500 +0200" stop="20100218075500 +0200" channel="RTL7-id"> --> <!-- display-name: This will be used in the xmltv file to give the channel's displayname. That is the name the epgprogram will use to display the channel. Give it any value you like. It is no problem if site_id , xmltv_id and display-name are equal --> <!-- Important ! Be aware that all channels entered here will be included in the xmltv channel table even if no update is requested. This allows the update of individual channels without affecting the data of the others in the list. A channel not in this list will be removed from your xmltv listing together with all the show data of it if found there by WebGrab+Plus. (If you use WebGrab+Plus with a xmltv input file from another source, it will remove all data from channels not in this list and create an entry for new channels) WebGrab+Plus uses the xmltv_id to identify a channel in an existing xmltv file. --> <!--Starhub Singapore--> <channel update="i" site="entertainment.xin.msn.com" site_id="Channel 5" xmltv_id="Channel 5">Channel 5</channel> <channel update="i" site="entertainment.xin.msn.com" site_id="Channel 8" xmltv_id="Channel 8">Channel 8</channel> <channel update="i" site="entertainment.xin.msn.com" site_id="Channel U" xmltv_id="Channel U">Channel U</channel> <channel update="i" site="entertainment.xin.msn.com" site_id="Suria" xmltv_id="Suria">Suria</channel> <channel update="i" site="entertainment.xin.msn.com" site_id="Vasantham" xmltv_id="Vasantham">Vasantham</channel> <channel update="i" site="entertainment.xin.msn.com" site_id="Okto" xmltv_id="Okto">Okto</channel> <channel update="i" site="entertainment.xin.msn.com" site_id="Channelnewsasia" xmltv_id="Channel News Asia">Channel News Asia</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=109" xmltv_id="TV4Me">TV4Me</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=115" xmltv_id="KBS World">KBS World</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=121" xmltv_id="MNC Business">MNC Business</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=122" xmltv_id="MNC International">MNC International</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=123" xmltv_id="Sensasi">Sensasi</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=124" xmltv_id="ONE (Malay)">ONE (Malay)</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=125" xmltv_id="Zee TV">Zee TV</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=126" xmltv_id="STAR Plus">STAR Plus</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=127" xmltv_id="Sony Entertainment Television">Sony Entertainment Television</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=128" xmltv_id="COLORS">COLORS</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=129" xmltv_id="STAR Gold">STAR Gold</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=130" xmltv_id="Zee Cinema">Zee Cinema</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=131" xmltv_id="SONY MAX">SONY MAX</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=132" xmltv_id="Channel [V] India">Channel [V] India</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=133" xmltv_id="Sun TV">Sun TV</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=134" xmltv_id="Sun Music">Sun Music</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=135" xmltv_id="Vijay">Vijay</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=136" xmltv_id="Vannathirai">Vannathirai</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=139" xmltv_id="Asianet">Asianet</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=140" xmltv_id="Channel-i">Channel-i</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=141" xmltv_id="Verna">Verna</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=143" xmltv_id="ANC">ANC</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=144" xmltv_id="The Filipino Channel">The Filipino Channel</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=145" xmltv_id="Cinema One Global">Cinema One Global</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=146" xmltv_id="Arirang TV">Arirang TV</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=147" xmltv_id="NHK World Premium">NHK World Premium</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=148" xmltv_id="NHK World TV">NHK World TV</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=149" xmltv_id="Hello! Japan">Hello! Japan</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=151" xmltv_id="Russia Today">Russia Today</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=152" xmltv_id="TV5MONDE Asie">TV5MONDE Asie</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=153" xmltv_id="DW (Asien)">DW (Asien)</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=157" xmltv_id="ZEE TV HD">ZEE TV HD</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=158" xmltv_id="Zee News">Zee News</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=159" xmltv_id="Zee Khana Khazana">Zee Khana Khazana</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=160" xmltv_id="Star Life OK">Star Life OK</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=161" xmltv_id="NDTV GOOD TIMES">NDTV GOOD TIMES</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=162" xmltv_id="NDTV 24x7">NDTV 24x7</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=167" xmltv_id="V Tamizh">V Tamizh</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=201" xmltv_id="SuperSports ARENA">SuperSports ARENA</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=202" xmltv_id="SuperSports">SuperSports</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=203" xmltv_id="SuperSports Plus">SuperSports Plus</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=205" xmltv_id="Eurosport">Eurosport</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=206" xmltv_id="Eurosportnews">Eurosportnews</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=207" xmltv_id="FOX Sports News">FOX Sports News</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=208" xmltv_id="FOX Sports">FOX Sports</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=209" xmltv_id="STAR Sports">STAR Sports</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=210" xmltv_id="FOX Sports Plus (HD)">FOX Sports Plus (HD)</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=211" xmltv_id="Racquet Channel">Racquet Channel</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=213" xmltv_id="Golf Channel">Golf Channel</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=215" xmltv_id="All Sports Network">All Sports Network</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=216" xmltv_id="NBA TV">NBA TV</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=217" xmltv_id="SETANTA">SETANTA</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=222" xmltv_id="Football Channel">Football Channel</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=226" xmltv_id="mio Stadium Multiview">mio Stadium Multiview</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=227" xmltv_id="mio Stadium 102 (HD)">mio Stadium 102 (HD)</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=228" xmltv_id="mio Stadium 103 (HD)">mio Stadium 103 (HD)</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=229" xmltv_id="mio Stadium 104 (HD)">mio Stadium 104 (HD)</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=230" xmltv_id="mio Stadium 105 (HD)">mio Stadium 105 (HD)</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=231" xmltv_id="mio Stadium 106 (HD)">mio Stadium 106 (HD)</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=232" xmltv_id="mio Stadium 107 (HD)">mio Stadium 107 (HD)</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=233" xmltv_id="mio Stadium 108 (HD)">mio Stadium 108 (HD)</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=235" xmltv_id="Ten Cricket">Ten Cricket</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=236" xmltv_id="STAR Cricket">STAR Cricket</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=255" xmltv_id="Sports HD">Sports HD</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=288" xmltv_id="Horse Racing Ch88">Horse Racing Ch88</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=289" xmltv_id="Horse Racing Ch89">Horse Racing Ch89</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=302" xmltv_id="BabyTV">BabyTV</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=303" xmltv_id="CBeebies">CBeebies</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=304" xmltv_id="Nick Jr">Nick Jr</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=308" xmltv_id="Discovery Kids">Discovery Kids</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=310" xmltv_id="Disney XD">Disney XD</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=311" xmltv_id="Disney Junior">Disney Junior</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=312" xmltv_id="Disney Channel">Disney Channel</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=314" xmltv_id="Nickelodeon">Nickelodeon</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=315" xmltv_id="Toonami">Toonami</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=316" xmltv_id="Cartoon Network">Cartoon Network</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=321" xmltv_id="momokids Asia">momokids Asia</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=401" xmltv_id="HISTORYâ„¢">HISTORYâ„¢</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=402" xmltv_id="H2">H2</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=403" xmltv_id="Crime and Investigation">Crime and Investigation</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=404" xmltv_id="The Biography Channel">The Biography Channel</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=407" xmltv_id="BBC Knowledge">BBC Knowledge</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=411" xmltv_id="National Geographic Channel">National Geographic Channel</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=412" xmltv_id="Nat Geo Adventure">Nat Geo Adventure</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=413" xmltv_id="Nat Geo Wild">Nat Geo Wild</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=422" xmltv_id="Discovery Channel">Discovery Channel</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=423" xmltv_id="Discovery Science">Discovery Science</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=424" xmltv_id="Animal Planet">Animal Planet</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=425" xmltv_id="Discovery Home & Health">Discovery Home & Health</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=426" xmltv_id="Discovery Turbo">Discovery Turbo</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=427" xmltv_id="TLC">TLC</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=432" xmltv_id="BBC Lifestyle">BBC Lifestyle</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=433" xmltv_id="Food Network Asia">Food Network Asia</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=435" xmltv_id="Asian Food Channel">Asian Food Channel</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=441" xmltv_id="E! Entertainment">E! Entertainment</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=442" xmltv_id="Style">Style</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=443" xmltv_id="Fashion TV">Fashion TV</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=446" xmltv_id="truTV">truTV</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=447" xmltv_id="Australia Network">Australia Network</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=457" xmltv_id="National Geographic Channel HD">National Geographic Channel HD</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=461" xmltv_id="Discovery HD">Discovery HD</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=473" xmltv_id="Travel Channel HD">Travel Channel HD</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=475" xmltv_id="Ginx (HD)">Ginx (HD)</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=501" xmltv_id="STAR World">STAR World</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=503" xmltv_id="FOXCRIME">FOXCRIME</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=505" xmltv_id="FOX">FOX</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=507" xmltv_id="FX">FX</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=511" xmltv_id="AXN">AXN</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=512" xmltv_id="Universal Channel">Universal Channel</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=514" xmltv_id="Lifetime">Lifetime</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=515" xmltv_id="WarnerTV">WarnerTV</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=516" xmltv_id="Comedy Central Asia">Comedy Central Asia</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=518" xmltv_id="KIX">KIX</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=521" xmltv_id="BBC Entertainment">BBC Entertainment</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=522" xmltv_id="DIVA Universal">DIVA Universal</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=523" xmltv_id="ITV Choice">ITV Choice</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=525" xmltv_id="beTV">beTV</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=526" xmltv_id="Syfy">Syfy</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=531" xmltv_id="Channel [V]">Channel [V]</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=532" xmltv_id="Animax">Animax</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=533" xmltv_id="MTV SEA">MTV SEA</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=535" xmltv_id="NAT GEO MUSIC">NAT GEO MUSIC</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=538" xmltv_id="iConcerts">iConcerts</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=580" xmltv_id="MTV LIVE HD">MTV LIVE HD</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=601" xmltv_id="HBO">HBO</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=603" xmltv_id="HBO Signature">HBO Signature</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=604" xmltv_id="HBO Family">HBO Family</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=605" xmltv_id="HBO Hits">HBO Hits</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=611" xmltv_id="Cinemax">Cinemax</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=613" xmltv_id="CinemaWorld">CinemaWorld</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=616" xmltv_id="Turner Classic Movies">Turner Classic Movies</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=618" xmltv_id="Thrill">Thrill</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=622" xmltv_id="FOX Movies Premium">FOX Movies Premium</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=624" xmltv_id="FOX Family Movies">FOX Family Movies</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=625" xmltv_id="FOX Action Movies HD">FOX Action Movies HD</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=701" xmltv_id="BBC World News">BBC World News</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=702" xmltv_id="FOX News Channel">FOX News Channel</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=703" xmltv_id="SKY News">SKY News</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=707" xmltv_id="CNBC">CNBC</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=708" xmltv_id="Bloomberg Television">Bloomberg Television</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=711" xmltv_id="CNN">CNN</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=712" xmltv_id="CNN Headline News">CNN Headline News</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=722" xmltv_id="CCTV News">CCTV News</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=801" xmltv_id="CCTV-4">CCTV-4</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=805" xmltv_id="Phoenix Chinese Channel">Phoenix Chinese Channel</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=806" xmltv_id="Phoenix InfoNews">Phoenix InfoNews</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=807" xmltv_id="Shen Zhou News Channel">Shen Zhou News Channel</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=808" xmltv_id="TVBS-NEWS">TVBS-NEWS</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=809" xmltv_id="China Business Network TV">China Business Network TV</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=820" xmltv_id="ONE (English)">ONE (English)</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=821" xmltv_id="XING KONG">XING KONG</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=822" xmltv_id="STAR Chinese Channel">STAR Chinese Channel</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=823" xmltv_id="ONE">ONE</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=824" xmltv_id="Ch M">Ch M</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=825" xmltv_id="E City">E City</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=826" xmltv_id="E City (+2)">E City (+2)</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=827" xmltv_id="CTI Asia Channel">CTI Asia Channel</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=828" xmltv_id="TVBS-ASIA">TVBS-ASIA</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=829" xmltv_id="TVB 8">TVB 8</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=830" xmltv_id="Jiangsu Satellite Channel">Jiangsu Satellite Channel</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=833" xmltv_id="Asia Travel">Asia Travel</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=836" xmltv_id="now Mango">now Mango</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=838" xmltv_id="TVBJ">TVBJ</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=845" xmltv_id="MTV China">MTV China</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=846" xmltv_id="KMTV">KMTV</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=847" xmltv_id="CHANNEL [V] Taiwan">CHANNEL [V] Taiwan</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=848" xmltv_id="CHANNEL [V] Mainland China">CHANNEL [V] Mainland China</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=851" xmltv_id="TTV World">TTV World</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=855" xmltv_id="VV Drama">VV Drama</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=856" xmltv_id="VV Drama (+3)">VV Drama (+3)</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=858" xmltv_id="TVB Classic Channel">TVB Classic Channel</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=859" xmltv_id="TVB Xing He Channel">TVB Xing He Channel</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=861" xmltv_id="now Baogu Movies">now Baogu Movies</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=866" xmltv_id="STAR Chinese Movies">STAR Chinese Movies</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=867" xmltv_id="STAR Chinese Movies Legend">STAR Chinese Movies Legend</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=868" xmltv_id="Celestial Movies">Celestial Movies</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=869" xmltv_id="Celestial Classic Movies">Celestial Classic Movies</channel> <channel update="i" site="starhub.com.en" site_id="isWeb=1&ch=876" xmltv_id="ONE HD">ONE HD</channel> </settings>
I am using "Big Screen EPG" (http://bigscreenglobal.com/) to load the resulting XMLTV file into Windows Media Center. This worked just fine with my TVXB setup, and it works just fine with the resulting XMKL from WebGrab+ as well.
But, I have two major problems:
1) For almost every show I get a log message like this:
Suspicious title in index page = The Sweet Truth
differs from title in showdetails = The Sweet Truth (?)And the show's title in WMC ends up like the second line, eg ending with the "(?)"
2) For a lot of shows, the program description in the resulting XML ends up just like this:
<desc lang="en">$esc.html($!program.prog_synopsis)(n)</desc>
Here is a typical entry from my guide.xml that shows both problems:
<programme start="20140105003000 +0800" stop="20140105013000 +0800" channel="Discovery Science">
<title lang="en">Extreme Engineering (?)</title>
<desc lang="en">$esc.html($!program.prog_synopsis)(n)</desc>
</programme>I guess I could somehow get around the first problem by playing with "title.modify" in my SiteIni files, but I don't thimnk that is how this should be solved. And the second problem looks like a bug to me, it looks to me as the name of some variables ended up in the description istead of the content of those variables.
These two problems makes my TV guide pretty much useless. It is very annoying to have all whos names prefixed by one or two spaces and then "(?)", and it's not very user friendly that most shows lacks a description.
These problems should be easily replicated by using my config file above together with the latest WebGrab+ and SiteIni files.
Please, can anyone help me with this?
chjohans,
I'll look into your problem.
Things I can say already, (on then good info you give)
1)
You can't remove the (?) with title.modify. I know, that is the first reaction I also got, when I first got that problem.
I'll explain why. WG++ has several stages it get show info. The first state is called the index_page. On most epg sites, you have an overview of all the shows (of 1 or multiple days). Next, you have a detail_page. That is a page that gives detailed info for 1 show. If for some reason, the title of the show on the index_page is not the same of the one on the detail_page, then a (?) is appended to the title. This is because a diff between these 2 titles can mean a bug/change on the site/siteini. So the (?) give you an indication that WG++ does not know for sure, if the data is gets on the detail_page is the one initialy intended.
In your case it will only be a space that is extra on the detail_page. Should be easy to fix.
2)
That will be a change on the site. And because that change on the site, WG++ only gets that strange text in stead of the correct description. Hopefully it will be simple to fix that.
I'll keep you updated
Thank you very much for your fast and thorough response :)
You should consider adding a "Donate" button where users can donate a small (or big) amount of money should they choose to do so. I like free software, but I also appreciate other peoples effort and time enough that I would like to contribute to the further development of software that I use!
Thanks again :)
starhub.com.en is updated (see the EPG channel pages)
Could you check it?
And could you check if the other one (entertainment.xin.msn.com) has issues, or if only this one was causing issues? (eg. just grab the channels from entertainment.xin.msn.com)
Thanks for the fast update. Channels for SiteID entertainment.xin.msn.com have no problems, they were OK all the time.
But I still see the exact same problems with SiteID starhub.com.en, I still get a massive amount of shows that's ending with " (?)" and I still get a lot of description text consisting of just "$esc.html($!program.prog_synopsis)(n)". The logfile logs the same errors as before.
It might be that you have fixed something for some of the channels, but the end result looks the same to me.
Hopefully I', not doing anything wrong, but I don't think so as this is pretty straightforward.I just dropped your updated SiteIni files for starhub in the right folder and overwrote the old ones, then I ran WebGrab again.
Hopefully this can be resolved somehow :)
Discovered a possible problem with the entertainment.xin.msn.com SiteIni file as well, the resulting category tag has lost of question marks in it. Some examples from my guide.xml:
<programme start="20140106010000 +0800" stop="20140106013000 +0800" channel="Channel 5">
<title lang="en">The Simpsons XXIII (HD)</title> <sub-title lang="en">Moe Goes From Rags To Riches</sub-title> <desc lang="en">This is the epic tale of Moe's bar rag, which began in Medieval France and made its way to the King of Persia before returning to America during the Great Depression. Eventually it is taken to Mount Everest, where it is found by a Yeti and given to a.(n)</desc> <category lang="en">Sitcom ???</category> <episode-num>12</episode-num> <rating> <value>PG</value> </rating> </programme> <programme start="20140106013000 +0800" stop="20140106020000 +0800" channel="Channel 5"> <title lang="en">Seconds From Disaster III</title> <sub-title lang="en">Asian Tsunami(Chinese Subtitles)</sub-title> <desc lang="en">This is an American documentary television series that investigates historically relevant man-made and natural disasters. Each episode aims to explain a single incident by analysing the causes and circumstances that affected the disaster.(n)</desc> <category lang="en">Drama ???</category> <episode-num>1</episode-num> </programme> <programme start="20140106020000 +0800" stop="20140106030000 +0800" channel="Channel 5"> <title lang="en">America's Next Top Model XVIII</title> <sub-title lang="en">Beverly Johnson(English Subtitles)</sub-title> <desc lang="en">The models attend go-sees and take part in a real runway show during Canada's Fashion week. During panel those that fail to get chosen by any designer risk elimination. Supermodel Beverly Johnson is the guest judge for the week.(n)</desc> <category lang="en">Variety ????</category> <episode-num>5</episode-num> </programme>Hopefully this can be fixed as well, but of course this is not as severe as the two other problems.
Could you upload your log file? I can't reproduce the problem of starthub.
The problem of msn.com, is that your XMLTV reader doesn't support some special unicode chars. If you look with a good ;-),plain text editor, you can see that there are some chineese chars at the end of the category. I think that this is the chinese translation of the category.
To remove the chinese chars, you can addd
index_category.modify {remove(type=regex)|[\u4E00-\u9FFF]}at the bottom of the siteini for the msn.com site.
The same I see for the description and title for channel="Channel 8". So there you could add
index_title.modify {remove(type=regex)|[\u4E00-\u9FFF]}index_subtitle.modify {remove(type=regex)|[\u4E00-\u9FFF]}index_description.modify {remove(type=regex)|[\u4E00-\u9FFF]}Don't know how the result will be. Because the site delivers the text mixed. Don't know if it is just a double translation. You could check this. And see if this is sufficient enough.
Hmm strange if you don't see the problem with Starhub, attaching my logfile to this post.
Regarding the questionmarks for the different categories at msn.com you're of course right, that looks like Chinese characters. I assume it's the Chinese translation of the categories. Same goes for the title and description for some other channels, there seems to be a Chinese translation after the english text. I will experiment with what you suggest above.
But the main thing is still all the questionmarks behind the show names and the strange text in the description. I'm very greatful for your help so far, thank you very much.
Hold on, forget that logfile. It seems like the Starhub problem is gone anyhow. All I did was that I added the commands above to remove Chinese characters to both the starhub and the msn SiteId files. I am positive that I ran WebGrab with your updated files and still got the problem, so this is very strange to me. But I'm happy it now seems to be working much better.
I see a few minor problems in the logfile so I'll post a follow-up here later. Thank you so much for your time and effort in solving this, that is really appreciated.
Is there a way I can donate a bit towards the further development of this excellent software?
Things are looking much better now,. but there is still a few annoying problems. I am attaching my config file, my lates logfile and both the site files for starhub and msn. These are my issues:
1) The code you gave me to remove Chinese characters from category, title, subtitle and description does not seem to do anything. Please see my attached siteini files and confirtm that this is indeed correct. I still have Chinese titles, categories and description in my guide.xml
2) There is still quite a few occurences (from siteini starhub) where title on the index page does not match the title on the details page. See the attached logfile. is it possible to fix this? it would not be so bad if the title from the index page was used, but the (wrong) title from the details page is used instead. It seems like it combines the original title with some other random (well probably not random) text. Does not seem like any question marks are added but the added text makes the title wrong. This makes it difficult to process with imdb, and it's a pain with series recordings. So this is still a major issue for me.
I really appreciate all your kind help so far, hopefully you'll be able to help me sort out the few remaining issues.
Ok, for the chinese chars, just use the latest beta version. I tested with the same version you are using and get the same results. Switching to the latest beta 53.5 solves this issue.
For starhub, I've rewritten the showsplitting part and adjusted the "title filtering". That way, most issues you saw, are gone (also with the beta version!)
Could you test it. I'm attaching it to this post, befor I'll release it. Just test and give your comments.
One thing I noticed during testing, is that the site sometimes gives an empty page. Not sure why. Adjusted the calling of the pages, but don't know if that is the cause. It could be that it is a sever issue and that we can't do anything about it. Maybe it could have to do with the server load or something like that. You will see if you encounter that. You can see when you hit that problem. It is when you get
in the description.
Excellent, now everything is working as it should. Please update the chinese version hf the starhub siteini as well, those updated files should be published. Thank you a million! :)
Since I'm using Windows Media Center I have to move 'episode' to 'subtitle" since MCE is not using the "subtitle" tag (well, it might be that the import program I'm using is at fault). But I'll play around with that myself, should not be too difficult. I guess I could do it in the SiteIni file, or as a postprocess using rex. I'll play around with both to learn.
Thanks again!
And where is that "donate" button!
Both are updated.
For the MCE, I would suggest the rex solution. That way, you separate the grabbing and the "layout". If the siteini has to change, you don't need to adjust it by hand.
The donate button sound like a good idea. But I'm not the person who is deciding these things.
It was working perfectly but sadly Starhub (again) changed their TV Guide this week so WebGrab+ cannot grab those guides at the moment. But I think francis is working on it so expect new and compatible ini-files to be available in a few days.
But, you say you are contemplating switching to WB+ for your TV recordings. You do understand that what this software will do is to grab the online TV guide and format it into an xm,ltv compatible xml file right?
Ok, good to know you're up and running. I made some changes to the ini file for entertainment.xin.msn.com to replace "subtitle" with "episode" if "episode" is not empty. This is necessary for WMC series recording to work correctly. I also "cleaned up" the description (removed chinese characters) and title a bit, removed some other unwanted text and formatted the episode number for on-screen viewing. You might want to try and add this to the end of your entertainment.xin.msn.com:
* Remove Chinese characters from category, title, subtitle and description index_category.modify {remove(type=regex)|[\u4E00-\u9FFF]} index_title.modify {remove(type=regex)|[\u4E00-\u9FFF]} index_subtitle.modify {remove(type=regex)|[\u4E00-\u9FFF]} index_description.modify {remove(type=regex)|[\u4E00-\u9FFF].*[\u4E00-\u9FFF]} * Remove "(n)" and double ".." from description index_description.modify {replace("(n)")|(n)|.} index_description.modify {replace("..")|..|.} index_description.modify {cleanup} * For WMC support set subtitle = episode if episode != "" index_temp_3.modify {clear} index_temp_3.modify {addstart |'index_episode'} * Format the subtitle (episode) so it's more readable index_temp_3.modify {remove()|Episode } index_temp_3.modify {remove()|Eps } index_temp_3.modify {remove()|Ep } index_temp_3.modify {remove("00")|'index_temp_3'} index_temp_3.modify {remove("0")|'index_temp_3'} index_temp_3.modify {addstart(not "")|Episode: } index_subtitle.modify {remove('index_temp_3' not "")|'index_subtitle'} index_subtitle.modify {addstart('index_temp_3' not "")|'index_temp_3'}Take note that my conversion of "episode" into "subtitle" does not follow any xmltv standard, but it formats the episode nicely (well, actually it just adds the tex "Episode: " and strips the episode number of the xmltv_ns formatting. So season and episode might be combined, but the point here is to allow WMC to differenciate each episode, not necessarily to show the exact season and episode number. This works well with the way Big Screen EPG handles episode data. but MCIImportXMLTV might handle this differently.
As fars as Big Screen EPG goes, yes I agree regarding the subscription based fee. But it has been working so well for me and I've been using it for about four years and back then I could not find a stable free alternative. And since the cost is minimal I'm not looking to change that.