You are here

docker.linuxserver.webgrabplus

37 posts / 0 new
Last post
jojo
Offline
Donator
Joined: 3 years
Last seen: 3 months
docker.linuxserver.webgrabplus

docker.linuxserver.webgrabplus cannot grab from web.magentatv.de

Blackbear199
Offline
Blackbear199's picture
WG++ Team memberDonator
Joined: 9 years
Last seen: 55 min

cant provide any help with "it dont work"
upload your webgrab log.

jojo
Offline
Donator
Joined: 3 years
Last seen: 3 months

Sorry.
There is my log.

Blackbear199
Offline
Blackbear199's picture
WG++ Team memberDonator
Joined: 9 years
Last seen: 55 min

try V4.2.2.3
https://github.com/SilentButeo2/webgrabplus-siteinipack/tree/master/eval...

its uses a new grab engine that may fix this problem.

Update:
i just tried it with 4.2.2.3 and it didnt work.
use V3.2.3.1(needs mono) or the latest V3.x.x docker image avail.
it works ok.

jojo
Offline
Donator
Joined: 3 years
Last seen: 3 months

It will probably be a bit of a problem. I use

ODROID N2+ 4G, CoreElec - 19.4-Matrix
Addon WebGrab+Plus(LinuxServer.io)LinuxServer.io-2.1.0
I don't know how to change the wg ++ version there.

Blackbear199
Offline
Blackbear199's picture
WG++ Team memberDonator
Joined: 9 years
Last seen: 55 min

dont use docker but if you install 2.1.0 and go into you container and relace all the files in the bin directory with the files from 3.2.3.1 it should work.

jojo
Offline
Donator
Joined: 3 years
Last seen: 3 months

Talk about the folder

/storage/.kodi/addons/docker.linuxserver.webgrabplus/bin/ ??

there are only two files - docker.linuxserver.webgrabplus and file - stop

The problem is that I don't know where the specific wg ++ files are. I can't find them anywhere

Blackbear199
Offline
Blackbear199's picture
WG++ Team memberDonator
Joined: 9 years
Last seen: 55 min

cd /storage/.kodi/addons/docker.linuxserver.webgrabplus
find -name "WebGrab+Plus.exe"
i assume this is in this directory somewhere.
version 2.1.0 may not have as many files as the bin directory of 3.2.3.1 does.
just copy everything from the bin directory of 3.2.3.1 to wherever the webgrab exe is in your docker container.

Blackbear199
Offline
Blackbear199's picture
WG++ Team memberDonator
Joined: 9 years
Last seen: 55 min

maybe the files are also mounted from outside the container
also try
cd /storage
find -name "WebGrab+Plus.exe"

Blackbear199
Offline
Blackbear199's picture
WG++ Team memberDonator
Joined: 9 years
Last seen: 55 min

i think your docker compose file should have the directory

jojo
Offline
Donator
Joined: 3 years
Last seen: 3 months

I found the wg ++ folder
/storage/.kodi/userdata/addon_data/service.system.docker/docker/overlay2/c4d60ab9d8b264f9c18a7400724491a51f9fabadef7d61e3164198b884a647dd/diff/app/wg++/

Attachments: 
Blackbear199
Offline
Blackbear199's picture
WG++ Team memberDonator
Joined: 9 years
Last seen: 55 min

thats for the 4.2.2.0 dotnet version.
u cannot replace the files there because the sh file to run the dotnet webgrab version uses different filename...WebGrabPlus.dll
u need to find a 3.x or even 2.x docker image.
these all use the WebGrab+Plus.exe

jojo
Offline
Donator
Joined: 3 years
Last seen: 3 months

I can't find wg ++ .exe anywhere, I found the installer

Attachments: 
Blackbear199
Offline
Blackbear199's picture
WG++ Team memberDonator
Joined: 9 years
Last seen: 55 min

only other thing u can do is dont install it as a docker image.
the default install path will be in /home/.wg++
for you i assume this will be /storage/.wg++

Blackbear199
Offline
Blackbear199's picture
WG++ Team memberDonator
Joined: 9 years
Last seen: 55 min

what i would do is simply extract the .wg++ folder from 3.2.3.1 and copy it to /storage
then in the .wg++ directory create a new sh file,say webgrab.sh
inside that put..

!#/bin/sh

mono /storage/.wg++/bin/WebGrab+Plus.exe /storage/.wg++

exit

make it executeable
chmod +x /storage/.wg++/webgrab.sh

to run webgrab..
/storage/.wg++/webgrab.sh

you may need to edit the above if mono is not in your path variable
/path/to/mono/mono /storage/.wg++/bin/WebGrab+Plus.exe /storage/.wg++

jojo
Offline
Donator
Joined: 3 years
Last seen: 3 months

We couldn't continue yesterday. Web page
was unavailable.

The only thing I managed was that I installed version 3.2.3 in the dock and somehow it started to work. It took me a long time to understand how the docker works.
The problem with your instructions is that version 4 does not use mono but dotnet. I didn't know how to put it together.
Or I misunderstood your instructions.

jojo
Offline
Donator
Joined: 3 years
Last seen: 3 months

Installation of WebGrab + Plus in the LibreElec and CoreElec System.

1. Install Addon Docker
Install from repository/All repositories/Services DOCKER
I wrote them all because some use LibreElec and others use CoreElec.

Open the terminal ssh:
2. Install WebGrab+Plus
Copy the entire code and paste it into the terminal. WebGrab+Plus is downloaded and configured automatically.

Code:

---

docker run -d \
--name=webgrabplus \
--hostname="Your WebGrab+Plus registered name" \
--mac-address="MAC address of your (already) registered PC at WebGrab+Plus" \
-e PUID=0 \
-e PGID=0 \
-e TZ=Europe/Amsterdam \
--restart unless-stopped \
linuxserver/webgrabplus:3.2.3

---

Replace Code and everything in them with your data.

Install;
3. There are two other folders in the volumes folder. They have a long name. (A mixture of letters and numbers)
Both folders contain one folder "_data"
One is empty (automatically there save guide.xml) and in the second are the WebGrab+Plus configuration files.

/storage/.kodi/userdata/addon_data/service.system.docker/docker/volumes/9a861848d91ffaae41779e1196a9e308d3c0b044fbe7fab240b22dde5bec8804/_data/
That folder name is unique and different for everyone!

How to configure "WebGrab ++. Config.xml" I will not deal with here. I guess that's clear.

All you have to do is use "license enforcement" in the login line. "f" Then when it clicks, remove the letter!

Autostart is set in the "wg3-cron" file

4. Restart Docker.

https://github.com/jojoxyz/Installation-of-WebGrab-Plus-in-the-LibreElec...

Blackbear199
Offline
Blackbear199's picture
WG++ Team memberDonator
Joined: 9 years
Last seen: 55 min
jojo wrote:

We couldn't continue yesterday. Web page
was unavailable.
The only thing I managed was that I installed version 3.2.3 in the dock and somehow it started to work. It took me a long time to understand how the docker works.
The problem with your instructions is that version 4 does not use mono but dotnet. I didn't know how to put it together.
Or I misunderstood your instructions.

dont worry about version 4 for now.
its doesnt work for this site,i posted above that i tried it.
version 4 uses a different grab engine that still needs some work.

jojo
Offline
Donator
Joined: 3 years
Last seen: 3 months

No problem. I made v3.2.3 and it works fine. I put the instructions on GitHub.

Blackbear199
Offline
Blackbear199's picture
WG++ Team memberDonator
Joined: 9 years
Last seen: 55 min

the issue with 4.x versions has been fix in V4.2.2.5 if u prefer to use dotnet
https://github.com/SilentButeo2/webgrabplus-siteinipack/tree/master/eval...

jojo
Offline
Donator
Joined: 3 years
Last seen: 3 months

Thank you for the information.

boxmax
Offline
Donator
Joined: 3 years
Last seen: 1 day

i try "run.net.sh" but i have :
=====
LibreELEC:~ # /storage/.wg++/./run.net.sh
You must install or update .NET to run this application.

App: /storage/.wg++/bin.net/WebGrab+Plus.dll
Architecture: x64
Framework: 'Microsoft.NETCore.App', version '7.0.0' (x64)
.NET location: /storage/.kodi/addons/tools.dotnet-runtime/bin/

The following frameworks were found:
6.0.27 at [/storage/.kodi/addons/tools.dotnet-runtime/bin/shared/Microsoft.NETCore.App]
8.0.2 at [/storage/.kodi/addons/tools.dotnet-runtime/bin/shared/Microsoft.NETCore.App]

Learn more:
https://aka.ms/dotnet/app-launch-failed

To install missing framework, download:
https://aka.ms/dotnet-core-applaunch?framework=Microsoft.NETCore.App&fra...

=====
how fix?

Blackbear199
Offline
Blackbear199's picture
WG++ Team memberDonator
Joined: 9 years
Last seen: 55 min

you can run webgrab manually with

dotnet /path/to/webgrab.dll /path/to/webgrab/config/directory

you may need to specify the full path to dotnet(i am not a docker user) something like this maybe..

/storage/.kodi/addons/tools.dotnet-runtime/bin/dotnet /storage/.wg++/bin.net/WebGrab+Plus.dll /storage/.wg++

boxmax
Offline
Donator
Joined: 3 years
Last seen: 1 day

not work
i install https://archive.libreelec.tv/addons/11.80.5/Generic/x86_64/tools.dotnet-...
and apply this line:
===========================
/storage/.kodi/addons/tools.dotnet-runtime/bin/dotnet /storage/.wg++/bin.net/WebGrab+Plus.dll /storage/.wg++/
=
You must install or update .NET to run this application.

App: /storage/.wg++/bin.net/WebGrab+Plus.dll
Architecture: x64
Framework: 'Microsoft.NETCore.App', version '7.0.0' (x64)
.NET location: /storage/.kodi/addons/tools.dotnet-runtime/bin/

The following frameworks were found:
6.0.27 at [/storage/.kodi/addons/tools.dotnet-runtime/bin/shared/Microsoft.NETCore.App]
8.0.2 at [/storage/.kodi/addons/tools.dotnet-runtime/bin/shared/Microsoft.NETCore.App]

Learn more:
https://aka.ms/dotnet/app-launch-failed

To install missing framework, download:
https://aka.ms/dotnet-core-applaunch?framework=Microsoft.NETCore.App&fra...

========
also i try copy https://dotnet.microsoft.com/en-us/download/dotnet/thank-you/runtime-asp...
in folder addon
and have this:
====
Process terminated. Couldn't find a valid ICU package installed on the system. Please install libicu (or icu-libs) using your package manager and try again. Alternatively you can set the configuration flag System.Globalization.Invariant to true if you want to run with no globalization support. Please see https://aka.ms/dotnet-missing-libicu for more information.
at System.Environment.FailFast(System.String)
at System.Globalization.GlobalizationMode+Settings..cctor()
at System.Globalization.CultureData.CreateCultureWithInvariantData()
at System.Globalization.CultureData.get_Invariant()
at System.Globalization.CultureInfo..cctor()
at System.Globalization.CultureInfo.get_CachedCulturesByName()
at System.Globalization.CultureInfo.GetCultureInfo(System.String)
at  .‥. (System.String[])
Aborted (core dumped)
=====

after install opkg install icu icu-data-tools icu-full-data
=
Unhandled exception. System.Globalization.CultureNotFoundException: Only the invariant culture is supported in globalization-invariant mode. See https://aka.ms/GlobalizationInvariantMode for more information. (Parameter 'name')
en-gb is an invalid culture identifier.
at System.Globalization.CultureInfo.GetCultureInfo(String name)
at  .‥. (String[])
Aborted (core dumped)

mat8861
Offline
WG++ Team memberDonator
Joined: 9 years
Last seen: 19 hours

Did you install globalization culture package ? This happens if your system doesn't have culture you want to run.

boxmax
Offline
Donator
Joined: 3 years
Last seen: 1 day

i think "globalization" in Package: icu74
LibreELEC:~ # opkg install icu
Package icu (74.2-1) installed in root is up to date.
====
LibreELEC:~ # /storage/.kodi/addons/tools.dotnet-runtime/bin/dotnet /storage/.wg++/bin.net/WebGrab+Plus.dll /storage/.wg++/
Process terminated. Couldn't find a valid ICU package installed on the system. Please install libicu (or icu-libs) using your package manager and try again. Alternatively you can set the configuration flag System.Globalization.Invariant to true if you want to run with no globalization support. Please see https://aka.ms/dotnet-missing-libicu for more information.
at System.Environment.FailFast(System.String)
at System.Globalization.GlobalizationMode+Settings..cctor()
at System.Globalization.CultureData.CreateCultureWithInvariantData()
at System.Globalization.CultureData.get_Invariant()
at System.Globalization.CultureInfo..cctor()
at System.Globalization.CultureInfo.get_CachedCulturesByName()
at System.Globalization.CultureInfo.GetCultureInfo(System.String)
at  .‥. (System.String[])
Aborted (core dumped)

mat8861
Offline
WG++ Team memberDonator
Joined: 9 years
Last seen: 19 hours

well is asking you to install libicu (or icu-libs)

boxmax
Offline
Donator
Joined: 3 years
Last seen: 1 day

Unfortunately, it is not known how to install libicu (or icu-libs) on the libreelec x64 pc
my system support docker and entware

Blackbear199
Offline
Blackbear199's picture
WG++ Team memberDonator
Joined: 9 years
Last seen: 55 min

reading through all this..
in post #24 u said you downloaded the linux binaries,the link you provided are for the asp.net core binaries.
this is the wrong one.
you want the dotnet runtime binaries.
https://dotnet.microsoft.com/en-us/download/dotnet/thank-you/runtime-7.0...

boxmax
Offline
Donator
Joined: 3 years
Last seen: 1 day

i re download now and try again
and install opkg
icu-data-tools_74.2-1_x64-3.2.ipk 24-Feb-2024 09:00 220362
icu-full-data_74.2-1_x64-3.2.ipk 24-Feb-2024 09:00 12012282
icu_74.2-1_x64-3.2.ipk
from: https://bin.entware.net/x64-k3.2/
and run again:
/storage/.kodi/addons/tools.dotnet-runtime/bin/dotnet /storage/.wg++/bin.net/WebGrab+Plus.dll /storage/.wg++/
same result:
LibreELEC:~ # /storage/.kodi/addons/tools.dotnet-runtime/bin/dotnet /storage/.wg++/bin.net/WebGrab+Plus.dll /storage/.wg++/
Process terminated. Couldn't find a valid ICU package installed on the system. Please install libicu (or icu-libs) using your package manager and try again. Alternatively you can set the configuration flag System.Globalization.Invariant to true if you want to run with no globalization support. Please see https://aka.ms/dotnet-missing-libicu for more information.
at System.Environment.FailFast(System.String)
at System.Globalization.GlobalizationMode+Settings..cctor()
at System.Globalization.CultureData.CreateCultureWithInvariantData()
at System.Globalization.CultureData.get_Invariant()
at System.Globalization.CultureInfo..cctor()
at System.Globalization.CultureInfo.get_CachedCulturesByName()
at System.Globalization.CultureInfo.GetCultureInfo(System.String)
at  .‥. (System.String[])
Aborted (core dumped)

Blackbear199
Offline
Blackbear199's picture
WG++ Team memberDonator
Joined: 9 years
Last seen: 55 min

i think i know what your problem is.
i will try to explain.

as i said above,you need to install the dotnet runtime binaries(you dont need the asp core stuff)
manually installing these isnt enough,you also need to add the path to your dotnet install folder to your PATH environment variable.

in my dotnet install folder /opt/dotnet/shared/Microsoft.NETCore.App/7.0.11
i have libSystem.Globalization.Native.so

when you run dotnet without the install directory added to the PATH environment variable its not finding these files.
i think thats the problem.

i will use my manual installation as a example,you will need to adjust the paths to whatever your install is.

i installed the dotnet runtime files in my /opt/dotnet directory
i also use a custom directory for my webgrab installation(/raid/data/NAS_WebGrab)

root@bb199:/opt/dotnet# ls -l
total 232
-rw-r--r-- 1 root root 1116 Oct 11 15:30 LICENSE.txt
-rw-r--r-- 1 root root 78479 Oct 11 15:30 ThirdPartyNotices.txt
-rwxr-xr-x 1 root root 141760 Oct 11 15:30 dotnet
drwxr-xr-x 3 root root 4096 Oct 1 12:10 host
drwxr-xr-x 3 root root 4096 Oct 1 12:10 shared

when i run webgrab i first add the path to my dotnet folder to my PATH environment variable...
i use a .sh file to run webgrab manually

export DOTNET_ROOT=/opt/dotnet
export PATH=$DOTNET_ROOT:$PATH

dotnet /raid/data/NAS_WebGrab/dotnet/WebGrab+Plus.dll /raid/data/NAS_WebGrab

for you,i assume your using the run.net.sh file?
if so edit the file and scroll to the bottom before webgrab is run add the export lines..

# add dotnet root folder to PATH environment variable,edit to you installation directory
export DOTNET_ROOT=/opt/dotnet
export PATH=$DOTNET_ROOT:$PATH

# load custom openssl.cnf
export OPENSSL_CONF="$DIR/bin.net/openssl.cnf"
dotnet "$DIR/bin.net/WebGrab+Plus.dll" "$DIR"

boxmax
Offline
Donator
Joined: 3 years
Last seen: 1 day

i try again for coreelec aarch64 & entware = work
but libreelec pc x64 & entware = not work
same issue icu not found

Blackbear199
Offline
Blackbear199's picture
WG++ Team memberDonator
Joined: 9 years
Last seen: 55 min

i did some searching on this,see here..
https://forum.libreelec.tv/thread/25748-run-asp-net-core-service-on-libr...

in that thread the user is setting the environment variable in systemd service file.
i think it would work if you set it manually before you run webgrab

in terminal try this..
export DOTNET_SYSTEM_GLOBALIZATION_INVARIANT=true
then try to run webgrab manually with the dotnet command.

if it works then edit the run.net.sh file as i said above and near the bottom before webgrab is run add the export command above.

boxmax
Offline
Donator
Joined: 3 years
Last seen: 1 day

i do that now and have this error:
=====
Unhandled exception. System.Globalization.CultureNotFoundException: Only the invariant culture is supported in globalization-invariant mode. See https://aka.ms/GlobalizationInvariantMode for more information. (Parameter 'name')
en-gb is an invalid culture identifier.
at System.Globalization.CultureInfo.GetCultureInfo(String name)
at  .‥. (String[])
Aborted (core dumped)
====
where i can edit :"en-gb" to "en-GB" ?

https://stackoverflow.com/questions/34765791/culture-is-not-supported-pa...

Blackbear199
Offline
Blackbear199's picture
WG++ Team memberDonator
Joined: 9 years
Last seen: 55 min

i was kinda expecting that.
looks like webgrab isnt going to work with libelec unless you can somehow figure out how to get icu working correctly.

the error your now getting is because each ini for a site has a cultureinfo setting,look on the site {xxx} line in a ini.
example cultureinfo=fr-FR

this is used by webgab in a few different ways.
one big one is for date calculations.
say a france site used the day name for part of the date calculation this setting would return Lundi for monday for example.
if it were en-GB it would return Monday.

boxmax
Offline
Donator
Joined: 3 years
Last seen: 1 day

The problem is that the script does not see where the lib files are
After searching, I found the solution:
========================
LD_LIBRARY_PATH="${LD_LIBRARY_PATH}:/opt/lib" ./run.net.sh
========================

also i try add :
======
export LD_LIBRARY_PATH="${LD_LIBRARY_PATH}:/opt/lib"
======
and work!

now how link xml for tvheadend ?

Blackbear199
Offline
Blackbear199's picture
WG++ Team memberDonator
Joined: 9 years
Last seen: 55 min

read..
http://webgrabplus.com/documentation/interact-your-pvr-software/tvheadend

its outdated but for this part( to add the cronjob to runwebgrab)..
15 2 * * * ~/.wg++/run.sh
you would use
15 2 * * * ~/.wg++/run.net.sh

you may also need to edit the tv_grab_wg++ file and change the guide.xml filename if you use different.
default is
xmltv_file_location=~/.wg++/guide.xml

Log in or register to post comments

Brought to you by Jan van Straaten

Program Development - Jan van Straaten ------- Web design - Francis De Paemeleere
Supported by: servercare.nl