-
-
Notifications
You must be signed in to change notification settings - Fork 37
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
fw.com urls fail #40
Comments
That's weird, that page is working fine for me. What's the exact command that you used? Have you seen this happen multiple times? Have you tried fetching the page with curl directly and piping it to rdrview? |
Ernesto Fernández ***@***.***> writes:
see below:
19:20:29 rdrview $ gh issue list
Showing 8 of 8 open issues in eafer/rdrview
ID TITLE LABELS UPDATED
#40 fw.com urls fail about 4 hours ago
#12 Convert to text about 27 days ago
19:20:34 rdrview $ gh issue view 40
fw.com urls fail eafer/rdrview#40
Open • tvraman opened about 2 days ago • 1 comment
as an example:
coult not fetch web page. Used to work until about a week ago.
eafer (Owner) • 4h • Newest comment
That's weird, that page is working fine for me. What's the exact command that you used? Have you seen this happen
multiple times? Have you tried fetching the page with curl directly and piping it to rdrview?
View this issue on GitHub: #40
19:20:58 rdrview $ curl 'https://www.fool.com/investing/2024/07/03/robinhood-golds-red-flag/?source=iedfolrf0000001' | wc
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 131k 0 131k 0 0 23718 0 --:--:-- 0:00:05 --:--:--
30497
# curl fetched it happily.
2209 8825 134526
19:24:47 ~ $ rdrview -T "title,sitename,body" -H 'https://www.fool.com/investing/2024/07/03/robinhood-golds-red-flag/?source=iedfolrf0000001 rdrview says'
rdrview: couldn't fetch the webpage# rdrview failed
|
There is a weird "rdrview says" inside the url, that's why the fetch fails. |
that is weird, still fails without that cruft:
rdrview -T "title,sitename,body" -H
'https://www.fool.com/investing/2024/07/03/robinhood-golds-red-flag/?source=iedfolrf0000001'
rdrview: couldn't fetch the webpage
--
Thanks,
…--Raman(I Search, I Find, I Misplace, I Research)
♉ Id: kg:/m/0285kf1 🦮
LOC: https://id.loc.gov/authorities/names/n97059241.html
|
It seems that rdrview fails to download some pages: #40 I'm guessing this is some CDN issue or something, but having more information would have been nice. Stop swallowing the curl errors, report them to the user in full.
The new release should provide better error reporting for url fetch failures. If you are still around and seeing this issue, try it out and let me know what you get. |
as an example: https://www.fool.com/investing/2024/07/03/robinhood-golds-red-flag/?source=iedfolrf0000001 rdrview says coult not fetch web page. Used to work until about a week ago.
The text was updated successfully, but these errors were encountered: