Logged in as root
VPS
Operating system = Ubuntu 18.04
All updates installed.
Mono full installed
After downloaded to ~/ Ran install as root .
Added channels from the siteini.pack.update/USA, only added channels from tv.com.channels.xml
TO: root/.wg++#/WebGrab++.config.xml
Ran /.wg++/run.sh
Get this .
WebGrab+Plus/w MDB & REX Postprocess -- version V3.1.0.0
Jan van Straaten
Francis De Paemeleere
thanks to Paul Weterings and all the contributing users
--------------------------------------------------------------------------------
Job started at 15/11/2020 19:08:37
Checking License ..
For License request/update data, see WGLicense.log.txt
The total channel count :20 exceeds the number 20 allowed for license 'default'
The total channel count set to :20
Job finished at 15/11/2020 19:08:38 done in 0s
Unable to select the siteini: tv.com.ini.
Multiple siteini's found, with @Revision 4
(@Revision 4)/root/.wg++/siteini.pack/USA/tv.com.ini
(@Revision 4)/root/.wg++/siteini.pack/siteini.user/tv.com.ini
at WG.Common.Utils.LocateIni (System.String Folder, System.String site) [0x00215] in <896f87e576a8482c8f603908a14ec73f>:0
at . ..ctor (System.String ) [0x00f28] in <896f87e576a8482c8f603908a14ec73f>:0
Unhandled Exception
For detailed info, see log file /root/.wg++/WebGrab++.log.txt
Execution stopped
Now I have not changed the site.whatever.com to my site, I don't know where to do that.
Please help me, I am so new to linux.
you have 2 site ini duplicates, remove/rename one, the one in siteiniuser i would say.
not being a donator you have a limit:
20 exceeds the number 20 allowed for license 'default'
ok, so I think I renamed what you are talking about. Please see the picture.
Yes, I am going to donate, I want to make sure I am up and running first.
Thank you for the info and help.
try to rename siteini not the folder.
ok, I will give it a try.
thank you, that work, I will go back to the manual but now I think I need to donate then put my subdomain.mydomain.com in my panel, but first I have more errors about cookies, I kind of vegly remember you have to go to a webpage and grab cookie info. Do you have to do this for each stream? Any shortcuts easy way.
i would use tvtv.us or another one, they work much better.
I am using TV.us now I get a buch of this after execution.
i
error downloading page: Error: SecureChannelFailure (The authentication or decryption has failed.)
pausing 1 of 4 times for 5 seconds before re-try.
error downloading page: Error: SecureChannelFailure (The authentication or decryption has failed.)
pausing 2 of 4 times for 10 seconds before re-try.
error downloading page: Error: SecureChannelFailure (The authentication or decryption has failed.)
pausing 3 of 4 times for 15 seconds before re-try.
error downloading page: Error: SecureChannelFailure (The authentication or decryption has failed.)
pausing 4 of 4 times for 20 seconds before re-try.
Unable to update channel Game Show Network - East
Generic syntax exception:
message:
no index page data received from Game Show Network - East
unable to update channel, try again later
No guide data to restore
( 1/20 ) TVTV.US -- chan. (xmltv_id=Jewelry Television) -- mode Force
i
error downloading page: Error: SecureChannelFailure (The authentication or decryption has failed.)
pausing 1 of 4 times for 5 seconds before re-try.
error downloading page: Error: SecureChannelFailure (The authentication or decryption has failed.)
pausing 2 of 4 times for 10 seconds before re-try.
error downloading page: Error: SecureChannelFailure (The authentication or decryption has failed.)
pausing 3 of 4 times for 15 seconds before re-try.
error downloading page: Error: SecureChannelFailure (The authentication or decryption has failed.)
pausing 4 of 4 times for 20 seconds before re-try.
Unable to update channel Jewelry Television
Generic syntax exception:
message:
no index page data received from Jewelry Television
unable to update channel, try again later
No guide data to restore
( 1/20 ) TVTV.US -- chan. (xmltv_id=SHOPHQ) -- mode Force
i
error downloading page: Error: SecureChannelFailure (The authentication or decryption has failed.)
pausing 1 of 4 times for 5 seconds before re-try.
error downloading page: Error: SecureChannelFailure (The authentication or decryption has failed.)
pausing 2 of 4 times for 10 seconds before re-try.
error downloading page: Error: SecureChannelFailure (The authentication or decryption has failed.)
pausing 3 of 4 times for 15 seconds before re-try.
error downloading page: Error: SecureChannelFailure (The authentication or decryption has failed.)
pausing 4 of 4 times for 20 seconds before re-try.
Unable to update channel SHOPHQ
Generic syntax exception:
message:
no index page data received from SHOPHQ
unable to update channel, try again later
No guide data to restore
( 1/20 ) TVTV.US -- chan. (xmltv_id=QVC2) -- mode Force
i
error downloading page: Error: SecureChannelFailure (The authentication or decryption has failed.)
pausing 1 of 4 times for 5 seconds before re-try.
error downloading page: Error: SecureChannelFailure (The authentication or decryption has failed.)
pausing 2 of 4 times for 10 seconds before re-try.
error downloading page: Error: SecureChannelFailure (The authentication or decryption has failed.)
pausing 3 of 4 times for 15 seconds before re-try.
Any ideas? I just purchased my license because at least I think I am on the right path. Now I need to make it work for my IPTV, do you have those instructions or know where to get them? Thank you, you have helped me get this far, thank you.
make sure mono is version 5 or greater.
Update license (see documentation)
use this sample https://github.com/SilentButeo2/webgrabplus-siteinipack/blob/master/site...
For tvtv.us also follow instruction (robots file needs to be modified and read only) see attached
What goes here, it looks like it is used to decrypt a sitecyfrowypolsat.pl.ek ?? There is a key there but from the sample one you linked me.
that is a sample of config, of course you need to add correct license data, keys and channels you need. Works fine as timeout and other settings for most of siteini's.
Thank you, ok now I am pulling channels down.
I want to use this with my iptv, whats next?
added picture.
in the forum there should be sample on how to add guide.xml to iptv
You need to install Apache.
https://ubuntu.com/tutorials/install-and-configure-apache#1-overview
Then you need to create a user account.
As Root
adduser USERNAME (your own username you want)
Enter New UNIX Password
Re-Enter New Unix Password
and the rest of the prompts you can leave blank.
usermod -aG sudo USERNAME
Make sure you can login with username
Add folder public_html
mkdir public_html
Set your Webgrab++.config.xml output to /home/USERNAME/public_html/guide.xml
(After fist scan you may need to edit permissions of guide.xml to be readable by others)
Run command:
sudo a2enmod userdir
Then go to your browser and type (Your IP) http:111.222.333/~USERNAME
You should see your guide.xml there now. For your panel use http:111.222.333/~USERNAME/guide.xml
I will give it a shot and report, thank you.
Unable to modify /home/USERNAME/public_html/guide.xml =
I get permission denied. I think I have to stop WebGrab, how do I do that?
ps aux and look for the process. There will be an if number.
Then type sudo kill -9 (process Id)
When I go to my panel, plug in http://myip/~username/guide.xml this is what I get below.
"DirecTV Sports 122
http://www.tvtv.us
DirecTV Sports 123
http://www.tvtv.us
"
When I go to my panel, plug in http://myip/~username/guide.xml, I am unable to pull channels etc. should I be using a port number?
you should output the guide to /var/www/html/
ok, do I need to change permissions?
What does the following mean.
!! -- WARNING : tvtv.us doesn't allow epg grabbing !!
it is advised to disable this channel / site from your channel list
i
Unable to update channel MHz Worldview
Generic syntax exception:
message:
no index page data received from MHz Worldview
unable to update channel, try again later
Existing guide data restored!
it's a warning do not worry...run a new channel list with update c that channel might have changed.
Modified the WebGrab++.config.xml
Changed update to c
Then ran ~/.wg++/run.sh
Modified the WebGrab++.config.xml
Changed back to f
I get ....
nd existing channel (xmltv_id=ViendoMovies) in the config file
Found existing channel (xmltv_id=De Pelicula) in the config file
Found existing channel (xmltv_id=FOROtv) in the config file
Found existing channel (xmltv_id=HITN) in the config file
Found existing channel (xmltv_id=Cine Mexicano) in the config file
Found existing channel (xmltv_id=TUDN) in the config file
Found existing channel (xmltv_id=Fox Deportes) in the config file
Found existing channel (xmltv_id=ESPN Deportes) in the config file
Found existing channel (xmltv_id=Gol TV USA) in the config file
Found existing channel (xmltv_id=TyC Sports) in the c
Then later I get a lot of the following.
Unable to update channel MHz Worldview
Generic syntax exception:
message:
no index page data received from MHz Worldview
unable to update channel, try again later
Existing guide data restored!
which site ini is this? tvtv.us ? if so did you set read only the robots file ? (see siteini remarks)
Ok, so yes, it is tvtv.us. everyone but the owner has read writes set already. I have attached a winscp picture of what is set.
is that for tvtv.us.robots file ? did you modified ?
Yes, this is the file. I may have tried to make it read only. What should the folder be and what should the file be in regards to permissions. I am fairly new user when it comes to Linux but I can get around.
I have attached a new picture of the robots file in /root/.wg++/robots/tvtv.us.robots . The permissions for the file is 0644 .
thank you for the help :)
run webgrab once(i assume u have already did).
then edit the tvtv robot txt file as mat said above.
remove write permission for even the owner...this is allowing it to be overwritten.
Ok, ran it once and set all to read only.
Now what am I supposed to do?
whats in your robot.txt file contain now?
when u run webgrab with write permission it should look something like this..
User-agent: *
Disallow: /tvm/
Disallow: /gn/
User-agent: WebGrab+Plus
Disallow: /
delete all except
User-agent: *
save it and make it read only
yes, it did look like this.
User-agent: *
Disallow: /tvm/
Disallow: /gn/
User-agent: WebGrab+Plus
Disallow: /
deleted and now has read only for directory and files in robots
User-agent: *
Bump, whats next please?
add channels to your config, see what log says
It's currently pulling down the channels, new shows added etc...
Thank you :) .... I should not jinx myself but I think I finally was able to do things correct. When you said to add the channels I went through the documentation and did so.
Yes, it is working
Question, I am missing some west channels, can I add more than one list, if so how would I do that?
Thank you :)
if you run update channel list, you can get a fresh/new list of channels. This site ini requires 2 run, one t ot get region provider, then with the line produced add to config to get the new channel list. It's all described in siteini, more info also here: http://www.webgrabplus.com/documentation/configuration/sitechannelsxml
When I ran it, the config.xml had the f switch for the update section. I am still missing west coast stuff for the most part. Is there a way to fill the gaps or would I have to try another list?
ok, I think it's working now so I edited this post as to not spam to much.
well done !! it is pretty clear in the siteini remarks what to do for channel list creation.
ok, so I am still stuck, I need a good list for mainly US but also Mexico/US for now, eventually UK. Currently the channel list I am using is showing the wrong show .
I do one of 2 things.
1. I keep 2 WebGrab++.config.xml files and just rename as I need to. I keep my main one but also keep a "scanner" one and rename it when not in use to config.SCANNER.xml and switch back and forth.
2. if you are using tvtv.us just go to their site and you can change the channel numbers and identifier yourself in the tvt.us.channels.xml and config file. So if you have NY for instance 8490D or whatever, just choose an LA service, change the code from the browser address bar and channel number to your files.
ok, I have attached a picture. Where do I get the number to change in the xml file. So basically the channels I selected and added to the XML file are showing the wrong shows.
I went to tvtv.us to hopefully find the correct channels and then change them in the xml file to represent the correct channels and data.
see picture
Thank you for the pictures, everything is working great.
Thank you to everyone :) .
Edit, added more channels to the webgrab++.config.xml file. Then ran WebGrab+Plus with f .
Now, none of my channels come up in my EPG.
Update, changed i and then pulled the epg and everything came back and the channels I added showed up.
How do I automate it in ubuntu.
You can create cron jobs but I found that they always quit early. But I’m running 5k channels. Might be ok on a short list.
You can create cron jobs but I found that they always quit early. But I’m running 5k channels. Might be ok on a short list.
Pretty new to linux, could you give me an example of yours. Then I will look up more details going forward on the net.
Frank, thank you for this :)
I think for this being run as root you would need to:
sudo su
enter password
crontab -e
## Add teh following line
0 0 * * * /root/wg++/run.sh
control C , Y to save
Then type:
crontab -l
This cron will have the job run every day at midnight. You can change time, day, month, etc by following this guide
https://phoenixnap.com/kb/set-up-cron-job-linux
Thank you, I did it and I will give it a couple days, thanks.
ok, so I did setup the timing, but around 5 AM this morning I ran a scan with I setting. The channels pulled fine but when I came back at 3:00 PM the channels guide didn't have anything in it.
So what I did is set it to pull every six hours 1 */6 * * * .
Ok, that didn’t solve my issue. How do you know when a crib job ran successfully, where is the log in Ubuntu 18.04. ?
you have to add log output to your cond
1 */6 * * * /root/wg++/run.sh >/path/to/where/you/want/log/saved/log.txt > 2>&1