Channel Ten not downloading again

[Craig Lister]

This was working after your very quickly applied fix but has now stopped. Error is :-

Choose> 18
INFO Downloading: Dancing With The Stars - S2 Ep. 8.ts
[cli][info] Found matching plugin hls for URL hlsvariant://https://10-selector.global.ssl.fastly.net/s/kYEXFC/media/6145524787001.m3u8?mbr=true&manifest=m3u&format=redirect&cb=1586919413
error: Unable to open URL: https://10-selector.global.ssl.fastly.net/s/kYEXFC/media/6145524787001.m3u8?mbr=true&manifest=m3u&format=redirect&cb=1586919413 (403 Client Error: Forbidden for url: https://10-selector.global.ssl.fastly.net/s/kYEXFC/media/6145524787001.m3u8?mbr=true&manifest=m3u&format=redirect&cb=1586919413))
ERROR streamlink exited with error code: 1
Press return to continue...

‌

[Craig Lister]

Hi, would really appreciate an update here as I have a bunch of vids I would like to D/L

[pawD]

@Craig Lister
I was having issue with ep. of other show but it works again after I apply the latest fix about ‘Browser Agent’.
I tried your ep. of the show while it also works for me.
Can you try again with the latest version for the program to confirm it still fail?

[Craig Lister]

Have tried again, using latest common and ten.py, but still fails :-Choose> 1
INFO Downloading: Dancing With The Stars - S1 Ep. 1.ts
[cli][info] Found matching plugin hls for URL hlsvariant://https://10-selector.global.ssl.fastly.net/s/kYEXFC/media/6003381403001.m3u8?mbr=true&manifest=m3u&format=redirect&cb=1587375006
error: Unable to open URL: https://10-selector.global.ssl.fastly.net/s/kYEXFC/media/6003381403001.m3u8?mbr=true&manifest=m3u&format=redirect&cb=1587375006 (403 Client Error: Forbidden for url: https://10-selector.global.ssl.fastly.net/s/kYEXFC/media/6003381403001.m3u8?mbr=true&manifest=m3u&format=redirect&cb=1587375006))
ERROR streamlink exited with error code: 1
Press return to continue...

[Craig Lister]

Lines included in common.py are :-

17 USER_AGENT = "Mozilla/5.0 (X11; Linux x86_64; rv:74.0) Gecko/20100101 Firefox/74.0"

93 http_session.headers["User-Agent"] = USER_AGENT

297 "--http-header", "User-Agent=" + USER_AGENT,

[pawD]

Are you able to watch from its website?
If so, can you try this from command line (DOS prompt/linux prompt) in one line:
streamlink --http-header User-Agent=”Mozilla/5.0 (X11; Linux x86_64; rv:74.0) Gecko/20100101 Firefox/74.0” -o "Dancing With The Stars - S1 Ep. 1.ts" “https://10-selector.global.ssl.fastly.net/s/kYEXFC/media/6003381403001.m3u8?mbr=true&manifest=m3u&format=redirect&cb=1587375006“ best

Hope that it may help to troubleshoot your issue.

[Craig Lister]

Hi, thanks for the response here is the test data :-

16:46:19$ streamlink --http-header User-Agent="Mozilla/5.0 (X11; Linux x86_64; rv:74.0) Gecko/20100101 Firefox/74.0" -o "Dancing With The Stars - S1 Ep. 1.ts" "hlsvariant://https://10-selector.global.ssl.fastly.net/s/kYEXFC/media/6003381403001.m3u8?mbr=true&manifest=m3u&format=redirect&cb=1587375006" best
[cli][info] Found matching plugin hls for URL hlsvariant://https://10-selector.global.ssl.fastly.net/s/kYEXFC/media/6003381403001.m3u8?mbr=true&manifest=m3u&format=redirect&cb=1587375006
error: Unable to open URL: https://10-selector.global.ssl.fastly.net/s/kYEXFC/media/6003381403001.m3u8?mbr=true&manifest=m3u&format=redirect&cb=1587375006 (403 Client Error: Forbidden for url: https://10-selector.global.ssl.fastly.net/s/kYEXFC/media/6003381403001.m3u8?mbr=true&manifest=m3u&format=redirect&cb=1587375006))

‌

‌

[pawD]

Hmmm…..that’s odd.
I imagine that it is not related to webdl as stand-alone streamlink also failed.

A bit searching found some ‘403 error’ issues related to streamlink. Explanations are either out-dated version of the streamlink or IP address is banned/out of quota.

My streamlink version is 1.3.0 for both Win10 and Linux and they both work. Thus, make sure your version is not out-dated.
Besides, if your ISP is not assign with static public IP, restart your broadband modem will normally pick up a new public IP which may resolve the issue if it was related to ban/out of quota.

You can check your streamlink version by:
pip3 freeze

‌

[Craig Lister]

Results of pip freeze -:

pip freeze
certifi==2020.4.5.1
chardet==3.0.4
idna==2.9
iso-639==0.4.5
iso3166==1.0.1
isodate==0.6.0
lxml==4.5.0
pkg-resources==0.0.0
pycryptodome==3.9.7
PySocks==1.7.1
requests==2.23.0
requests-cache==0.5.2
six==1.14.0
streamlink==1.3.1
urllib3==1.25.9
websocket-client==0.57.0

[pawD]

Mine certainly different as it was setup quite a while back. Thus, I create a new virtualenv which have the same versions and packages as yours.
Yet, it still works with bare/standalone streamlink command.
I will try to setup fresh on another RPi to see it maybe different.

Somehow, I have strong feeling that it may not relate to your setup or webdl.
In order to rule out other causes, are you able to get another public IP to test as I responded earlier or using a proxy-server elsewhere in oz to test?

[delx]

This seems to vary depending on what network. I get 403 errors when connecting from Internode and Optus fixed line connections, but it works fine from Amaysim mobile data :|

It also doesn’t work in the web browser, is this the case for others too? If so try complaining to Ten directly and maybe they’ll fix it :)

[Tyler Durden]

I am also having the same problem..

It was downloading good prior to this…
using the same webdl setup so not sure what has cause this problem.

Any suggestions how to fix this?

[pawD]

@Tyler Durden , as per trouble-shooting performed. Please provide the followings:

1- Which ISP you are using? Are you using fixed-line, 4G or unwire connection from ISP?

2- Are you able to watch the show from 10’s website?

[Tyler Durden]

@pawD
Using fixed line.
ISP is with one of the BIG companies.
Yes I can stream it from 10 website

BTW how did you make my reply name in colour blue?

[pawD]

@Tyler Durden , not sure about the colour blue, just select the name under ‘madmax3’.

As per delx findings, it seems 10 may block (accidentally?) users from at least two ISPs.
Strangely, you are able to stream from their website which seems not the case.

I checked with Craig Lister about streaming from 10’s website but not having any response on this. Thus, not sure you two are having same issue or not.

Meanwhile, please check your version of streamlink and also direct command with streamlink:

pip3 freeze

streamlink --http-header User-Agent=”Mozilla/5.0 (X11; Linux x86_64; rv:74.0) Gecko/20100101 Firefox/74.0” -o "Dancing With The Stars - S1 Ep. 1.ts" “https://10-selector.global.ssl.fastly.net/s/kYEXFC/media/6003381403001.m3u8?mbr=true&manifest=m3u&format=redirect&cb=1587375006“ best

‌

[Tyler Durden]

@pawD

What you mean select the name under …?
I can’t select anything under your name..
can you post a screenshot of what you mean?

N:\webdl>pip3 freeze
attrs==18.1.0
beautifulsoup4==4.8.2
certifi==2019.11.28
chardet==3.0.4
ConfigArgParse==1.0
coursera-dl==0.11.5
idna==2.8
keyring==21.1.0
pyasn1==0.4.8
pywin32-ctypes==0.2.0
requests==2.22.0
six==1.14.0
soupsieve==1.9.5
urllib3==1.25.8

how do I run stream link from cmd?

C:\Users\[removed]>streamlink --http-header User-Agent="Mozilla/5.0 (X11; Linux x86_64; rv:74.0) Gecko/20100101 Firefox/74.0" -o "Dancing With The Stars - S1 Ep. 1.ts" "https://10-selector.global.ssl.fastly.net/s/kYEXFC/media/6003381403001.m3u8?mbr=true&manifest=m3u&format=redirect&cb=1587375006" best
'streamlink' is not recognized as an internal or external command,
operable program or batch file.

‌

[pawD]

@Tyler Durden , here is the screen-shot when I type '@' and your name.

‌

It seems to me that you are not yet activate the setup with webdl.
i.e. You need to execute the same bat/cmd file which enable you to run grabber.py/autograbber.py
It shall be something like:

[your setup directory]\bin\activate

‌

[Tyler Durden]

@pawD okay I see what you mean by the dropdown names now but I don’t see your name or username in the dropdown box
Also I know how it was due to my adblocker/popup blocker that was the reason it didn’t show any dropdown box

How do you know which Tyler Durden to pick from the list?

Not sure if you mean just run the grabber like normally how I run it but this is the error I get after running my batch file

‌

N:\webdl\.virtualenv\Scripts\activate.bat && python grabber.py

Choose> 1
INFO Downloading: Hughesy We Have a Problem - S3 Ep. 11.ts
[cli][info] Found matching plugin hls for URL hlsvariant://https://10-selector.global.ssl.fastly.net/s/kYEXFC/media/6146717574001.m3u8?mbr=true&manifest=m3u&format=redirect&vtoken=1588121871_b2da65f3fc9a31af03256b3593f3b90f0384cdd4037da772c5d3d820a3e2249b
error: Unable to open URL: https://10-selector.global.ssl.fastly.net/s/kYEXFC/media/6146717574001.m3u8?mbr=true&manifest=m3u&format=redirect&vtoken=1588121871_b2da65f3fc9a31af03256b3593f3b90f0384cdd4037da772c5d3d820a3e2249b (404 Client Error: Not found for url: https://10-selector.global.ssl.fastly.net/s/kYEXFC/media/6146717574001.m3u8?mbr=true&manifest=m3u&format=redirect&vtoken=1588121871_b2da65f3fc9a31af03256b3593f3b90f0384cdd4037da772c5d3d820a3e2249b)
ERROR streamlink exited with error code: 1
Press return to continue...

‌

[Tyler Durden]

@pawD  okay I got it to work now after updating the webdl

git pull --ff-only

BTW how would I be able to update streamlink in windows cmd?

[pawD]

@Tyler Durden , I just hover mouse on the icon in front of your name (i.e. Circled ‘TD’) and then select the one with ‘madmax3’. On the other hand, ‘pawd’ is my username which is unique (same for yours) and hence no selection available.

‌

Glad to hear that you have fixed your issue by update to the latest webdl.
You can check you current version with following command:

N:\webdl\.virtualenv\Scripts\activate.bat && pip freeze

If your want to update steamlink, you may execute the following in Command Prompt:

N:\webdl\.virtualenv\Scripts\activate.bat && pip install -U streamlink

In case it may return error, you may need to replace ‘pip’ with ‘pip3’.

[delx]

This still seems to be happening, but I'm not sure I can do anything about it as long as the streaming also doesn't work from the website.