Unable to update channel Lithuania: Discovery Science
[Critical] Generic syntax exception:
[Critical] message:
[Error ] no index page data received from Lithuania: Discovery Science
[Error ] unable to update channel, try again later
on site there is data, i can see epg https://tvepg.eu/lt/lithuania/channel/discovery_science
they added a captcha,no longer can grab epg.
wget passses captcha... wget --load-cookies cookies.txt -U "Mozilla/5.0 (X11; Linux x86_64; rv:109.0) Gecko/20100101 Firefox/115.0" https://tvepg.eu/lt/lithuania/channel/lnk/2023-12-29 -O test.html
really here is issue?
read the remarks at the top of ini.
i modified the ini in the spring to use coookie to get past the capcha,it work then.
it doesnt now and i dont see any changes on the site.
so they did something else that killed web scraping.
tried sending the request through flaresolverr(it can sometime get past cloudfare chanllenge).
even it fails..
2023-12-28 09:19:15 INFO Incoming request => POST /v1 body: {'cmd': 'request.get', 'url': 'https://tvepg.eu/en/united_kingdom/channel/bbc_one/2023-12-28', 'maxTimeout': 60000}
2023-12-28 09:19:26 INFO Challenge detected. Title found: Just a moment...
2023-12-28 09:19:44 ERROR Error: Error solving the challenge. Timeout after 60.0 seconds.
had another look at this and figured it out.
turns out the cookie file needs to be created from a pc using the same wan ip as pc running webgrab.
possibly the same pc that running webgrab.
my scenario.
i always have chrome browser set to use my vpn
webgrab doesnt use vpn
cookie saved with chrome gives 403 forbidden.
what worked.
changed chrome to not use vpn.
in browser setting deleted all cookies for tvepg.eu
refreshed site,seen the cloudfare challenge
saved cookie as per what remarks say in the top of the ini.
ran webgrab and it works again.
Until it doesn't work anymore