Wall Street Journal - subscription version broken

duluoz · 06-02-2020, 07:27 PM

Hi,

The subscription version of the Wall Street Journal are not working for me - looks like something to do with how the login details are processed. Error message below:

Code:

calibre, version 4.17.0 (linux2, embedded-python: True)
Conversion error: Failed: Fetch news from The Wall Street Journal

Fetch news from The Wall Street Journal
Conversion options changed from defaults:
  verbose: 2
  output_profile: u'kindle_pw3'
Resolved conversion options
calibre version: 4.17.0
{'asciiize': False,
 'author_sort': None,
 'authors': None,
 'base_font_size': 0,
 'book_producer': None,
 'change_justification': u'original',
 'chapter': None,
 'chapter_mark': u'pagebreak',
 'comments': None,
 'cover': None,
 'debug_pipeline': None,
 'dehyphenate': True,
 'delete_blank_paragraphs': True,
 'disable_font_rescaling': False,
 'dont_compress': False,
 'dont_download_recipe': False,
 'duplicate_links_in_toc': False,
 'embed_all_fonts': False,
 'embed_font_family': None,
 'enable_heuristics': False,
 'expand_css': False,
 'extra_css': None,
 'extract_to': None,
 'filter_css': None,
 'fix_indents': True,
 'font_size_mapping': None,
 'format_scene_breaks': True,
 'html_unwrap_factor': 0.4,
 'input_encoding': None,
 'input_profile': <calibre.customize.profiles.InputProfile object at 0x7f37ddc2a790>,
 'insert_blank_line': False,
 'insert_blank_line_size': 0.5,
 'insert_metadata': False,
 'isbn': None,
 'italicize_common_cases': True,
 'keep_ligatures': False,
 'language': None,
 'level1_toc': None,
 'level2_toc': None,
 'level3_toc': None,
 'line_height': 0,
 'linearize_tables': False,
 'lrf': False,
 'margin_bottom': 5.0,
 'margin_left': 5.0,
 'margin_right': 5.0,
 'margin_top': 5.0,
 'markup_chapter_headings': True,
 'max_toc_links': 50,
 'minimum_line_height': 120.0,
 'mobi_file_type': u'old',
 'mobi_ignore_margins': False,
 'mobi_keep_original_images': False,
 'mobi_toc_at_start': False,
 'no_chapters_in_toc': False,
 'no_inline_navbars': True,
 'no_inline_toc': False,
 'output_profile': <calibre.customize.profiles.KindlePaperWhite3Output object at 0x7f37ddc2af90>,
 'page_breaks_before': None,
 'personal_doc': u'[PDOC]',
 'prefer_author_sort': False,
 'prefer_metadata_cover': False,
 'pretty_print': False,
 'pubdate': None,
 'publisher': None,
 'rating': None,
 'read_metadata_from_opf': None,
 'remove_fake_margins': True,
 'remove_first_image': False,
 'remove_paragraph_spacing': False,
 'remove_paragraph_spacing_indent_size': 1.5,
 'renumber_headings': True,
 'replace_scene_breaks': u'',
 'search_replace': None,
 'series': None,
 'series_index': None,
 'share_not_sync': False,
 'smarten_punctuation': False,
 'sr1_replace': u'',
 'sr1_search': u'',
 'sr2_replace': u'',
 'sr2_search': u'',
 'sr3_replace': u'',
 'sr3_search': u'',
 'start_reading_at': None,
 'subset_embedded_fonts': False,
 'tags': None,
 'test': False,
 'timestamp': None,
 'title': None,
 'title_sort': None,
 'toc_filter': None,
 'toc_threshold': 6,
 'toc_title': None,
 'transform_css_rules': None,
 'unsmarten_punctuation': False,
 'unwrap_lines': True,
 'use_auto_toc': False,
 'verbose': 2}
InputFormatPlugin: Recipe Input running
Downloading recipe urn: builtin:wsj
Trying to get latest version of recipe: wsj
Using user agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/73.0.3683.86 Safari/537.36
Starting login process...
Sending login request...
Performing login callback...
Traceback (most recent call last):
  File "site.py", line 77, in main
  File "site-packages/calibre/utils/ipc/worker.py", line 209, in main
  File "site-packages/calibre/gui2/convert/gui_conversion.py", line 36, in gui_convert_recipe
  File "site-packages/calibre/gui2/convert/gui_conversion.py", line 28, in gui_convert
  File "site-packages/calibre/ebooks/conversion/plumber.py", line 1110, in run
  File "site-packages/calibre/customize/conversion.py", line 246, in __call__
  File "site-packages/calibre/ebooks/conversion/plugins/recipe_input.py", line 138, in convert
  File "site-packages/calibre/web/feeds/news.py", line 904, in __init__
  File "<string>", line 153, in get_browser
ValueError: Failed to login (callback URL failed), check username and password

Username and password are correct, and I can share if needed to debug. Thanks.

kovidgoyal · 06-03-2020, 12:23 AM

Works fine for me, and no one else has reported issues either. Check your subscription status.

nelson1379 · 07-05-2020, 06:57 AM

Good morning,

I've been getting this error yesterday and today:

Quote:

Starting login process...
Sending login request...
Performing login callback...
1% Fetching feeds...
1% Got feeds from index page
Traceback (most recent call last):
File "/usr/bin/ebook-convert", line 20, in <module>
sys.exit(main())
File "/usr/lib64/calibre/calibre/ebooks/conversion/cli.py", line 401, in main
plumber.run()
File "/usr/lib64/calibre/calibre/ebooks/conversion/plumber.py", line 1108, in run
self.oeb = self.input_plugin(stream, self.opts,
File "/usr/lib64/calibre/calibre/customize/conversion.py", line 245, in __call__
ret = self.convert(stream, options, file_ext,
File "/usr/lib64/calibre/calibre/ebooks/conversion/plugins/recipe_input.py", line 138, in convert
ro.download()
File "/usr/lib64/calibre/calibre/web/feeds/news.py", line 1028, in download
res = self.build_index()
File "/usr/lib64/calibre/calibre/web/feeds/news.py", line 1207, in build_index
raise ValueError('No articles found, aborting')
ValueError: No articles found, aborting
Traceback (most recent call last):
File "/usr/bin/calibre-smtp", line 20, in <module>
sys.exit(main())
File "/usr/lib64/calibre/calibre/utils/smtp.py", line 291, in main
msg = compose_mail(args[1], args[2], args[3], subject=opts.subject,
File "/usr/lib64/calibre/calibre/utils/smtp.py", line 271, in compose_mail
else open(attachment, 'rb').read()

It's a bit different from the error the previous poster experienced. The "No articles found" text suggests to me that the Wall Street Journal may have changed their website so that the recipe no longer recognizes where to fetch articles.

kovidgoyal · 07-05-2020, 07:41 AM

That's likely a bug on the website, if you go to https://www.wsj.com/print-edition/20200704/frontpage its largely empty, you should report it to the wsj and hopefully they will fix it.

modelstudent101 · 07-06-2020, 05:24 AM

I'm having a different problem, but only on a deprecated version of Calibre (3.39 running on Debian Stretch).

Code:

calibre, version 3.39.1 (linux2, embedded-python: False)
Conversion error: Failed: Fetch news from The Wall Street Journal

Fetch news from The Wall Street Journal
Conversion options changed from defaults:
  verbose: 2
  output_profile: u'kindle_voyage'
(REMOVED EBOOK FORMATTING)
InputFormatPlugin: Recipe Input running
Downloading recipe urn: builtin:wsj
Trying to get latest version of recipe: wsj
Starting login process...
Sending login request...
Traceback (most recent call last):
  File "/usr/bin/calibre-parallel", line 20, in <module>
    sys.exit(main())
  File "/usr/lib/calibre/calibre/utils/ipc/worker.py", line 199, in main
    result = func(*args, **kwargs)
  File "/usr/lib/calibre/calibre/gui2/convert/gui_conversion.py", line 35, in gui_convert_recipe
    override_input_metadata=override_input_metadata)
  File "/usr/lib/calibre/calibre/gui2/convert/gui_conversion.py", line 27, in gui_convert
    plumber.run()
  File "/usr/lib/calibre/calibre/ebooks/conversion/plumber.py", line 1106, in run
    accelerators, tdir)
  File "/usr/lib/calibre/calibre/customize/conversion.py", line 244, in __call__
    log, accelerators)
  File "/usr/lib/calibre/calibre/ebooks/conversion/plugins/recipe_input.py", line 135, in convert
    ro = recipe(opts, log, self.report_progress)
  File "/usr/lib/calibre/calibre/web/feeds/news.py", line 901, in __init__
    self.browser = self.get_browser()
  File "<string>", line 140, in get_browser
  File "/usr/lib/python2.7/dist-packages/mechanize/_mechanize.py", line 203, in open
    return self._mech_open(url, data, timeout=timeout)
  File "/usr/lib/python2.7/dist-packages/mechanize/_mechanize.py", line 230, in _mech_open
    response = UserAgentBase.open(self, request, data)
  File "/usr/lib/python2.7/dist-packages/mechanize/_opener.py", line 193, in open
    response = urlopen(self, req, data)
  File "/usr/lib/python2.7/dist-packages/mechanize/_urllib2_fork.py", line 344, in _open
    '_open', req)
  File "/usr/lib/python2.7/dist-packages/mechanize/_urllib2_fork.py", line 332, in _call_chain
    result = func(*args)
  File "/usr/lib/calibre/calibre/utils/browser.py", line 28, in https_open
    return self.do_open(conn_factory, req)
  File "/usr/lib/python2.7/dist-packages/mechanize/_urllib2_fork.py", line 1115, in do_open
    h.request(req.get_method(), req.get_selector(), req.data, headers)
  File "/usr/lib/python2.7/httplib.py", line 1058, in request
    self._send_request(method, url, body, headers)
  File "/usr/lib/python2.7/httplib.py", line 1098, in _send_request
    self.endheaders(body)
  File "/usr/lib/python2.7/httplib.py", line 1054, in endheaders
    self._send_output(message_body)
  File "/usr/lib/python2.7/httplib.py", line 896, in _send_output
    self.send(message_body)
  File "/usr/lib/python2.7/httplib.py", line 868, in send
    self.sock.sendall(data)
  File "/usr/lib/python2.7/ssl.py", line 741, in sendall
    v = self.send(data[count:])
TypeError: unhashable type

Is this due to running an older version? Not having the issue on a Windows 10 machine running 4.20...

nelson1379 · 07-06-2020, 06:49 AM

Quote:

Originally Posted by kovidgoyal

That's likely a bug on the website, if you go to https://www.wsj.com/print-edition/20200704/frontpage its largely empty, you should report it to the wsj and hopefully they will fix it.

You're right, it worked today. Thank you for looking into it.

modelstudent101 · 07-06-2020, 05:39 PM

Update on the issue re: unhashable type error.

Only occurs with WSJ.recipe, and not WSJ_FREE.recipe - appears to be an issue with the login process. WSJ_FREE.recipe works perfectly fine, but it appears that there's a hangup after sending login information - happens in both command line and GUI.

kovidgoyal · 07-06-2020, 11:20 PM

@modelstudent101: Linux distro packages of calibre are not supported. Use the official calibre binaries and you will be fine.

modelstudent101 · 07-07-2020, 06:01 PM

@kovidgoyal - Ahhh okay, unfortunately the binaries aren't supported on ARM and I'm not running ARCH. Not that difficult for me to run on the desktop. Thanks for everything you do and creating/maintaining such an amazing resource.

akakindleuser · 08-29-2020, 02:49 PM

I am having the same issue as duluoz with the WSJ. My username and password for the WSJ seem correct but Calibre is giving me a "Failed Fetch news from The Wall Street Journal" error.

This using the subscription and not 'free' 'Fetch News' option.

Another thing, I don't think this is related but I saw on other pages something about the https://www.wsj.com/digital-print-edition?mod=wsjheader page being devoid of content.

I noticed that they have an ereader version you can click on from that page, I don't know if calibre can pull from that page but it seems like that's the version you would want to download if you could.

http://ereader.wsj.net/?editionStart...Street+Journal

Spoiler:

If anyone knows what to do to get this to work, thank you in advance!

mjfriedman · 12-01-2020, 07:39 AM

I also am getting hangs:

Fetch news from The Wall Street Journal
Failed to initialize plugin: '/Users/michael/Library/Preferences/calibre/plugins/DeDRM.zip'
Conversion options changed from defaults:
output_profile: 'kindle_voyage'
verbose: 2
Resolved conversion options
calibre version: 5.6.0
{'asciiize': False,
'author_sort': None,
'authors': None,
'base_font_size': 0,
'book_producer': None,
'change_justification': 'original',
'chapter': None,
'chapter_mark': 'pagebreak',
'comments': None,
'cover': None,
'debug_pipeline': None,
'dehyphenate': True,
'delete_blank_paragraphs': True,
'disable_font_rescaling': False,
'dont_compress': False,
'dont_download_recipe': False,
'duplicate_links_in_toc': False,
'embed_all_fonts': False,
'embed_font_family': None,
'enable_heuristics': False,
'expand_css': False,
'extra_css': None,
'extract_to': None,
'filter_css': None,
'fix_indents': True,
'font_size_mapping': None,
'format_scene_breaks': True,
'html_unwrap_factor': 0.4,
'input_encoding': None,
'input_profile': <calibre.customize.profiles.InputProfile object at 0x1176a57c0>,
'insert_blank_line': False,
'insert_blank_line_size': 0.5,
'insert_metadata': False,
'isbn': None,
'italicize_common_cases': True,
'keep_ligatures': False,
'language': None,
'level1_toc': None,
'level2_toc': None,
'level3_toc': None,
'line_height': 0,
'linearize_tables': False,
'lrf': False,
'margin_bottom': 5.0,
'margin_left': 5.0,
'margin_right': 5.0,
'margin_top': 5.0,
'markup_chapter_headings': True,
'max_toc_links': 50,
'minimum_line_height': 120.0,
'mobi_file_type': 'old',
'mobi_ignore_margins': False,
'mobi_keep_original_images': False,
'mobi_toc_at_start': False,
'no_chapters_in_toc': False,
'no_inline_navbars': True,
'no_inline_toc': False,
'output_profile': <calibre.customize.profiles.KindleVoyageOutput object at 0x1176a5df0>,
'page_breaks_before': None,
'personal_doc': '[PDOC]',
'prefer_author_sort': False,
'prefer_metadata_cover': False,
'pretty_print': False,
'pubdate': None,
'publisher': None,
'rating': None,
'read_metadata_from_opf': None,
'remove_fake_margins': True,
'remove_first_image': False,
'remove_paragraph_spacing': False,
'remove_paragraph_spacing_indent_size': 1.5,
'renumber_headings': True,
'replace_scene_breaks': '',
'search_replace': None,
'series': None,
'series_index': None,
'share_not_sync': False,
'smarten_punctuation': False,
'sr1_replace': '',
'sr1_search': '',
'sr2_replace': '',
'sr2_search': '',
'sr3_replace': '',
'sr3_search': '',
'start_reading_at': None,
'subset_embedded_fonts': False,
'tags': None,
'test': False,
'timestamp': None,
'title': None,
'title_sort': None,
'toc_filter': None,
'toc_threshold': 6,
'toc_title': None,
'transform_css_rules': None,
'unsmarten_punctuation': False,
'unwrap_lines': True,
'use_auto_toc': False,
'verbose': 2}
InputFormatPlugin: Recipe Input running
Downloading recipe urn: builtin:wsj
Trying to get latest version of recipe: wsj
Using user agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/73.0.3683.86 Safari/537.36
Starting login process...
Sending login request...
Performing login callback...
Found section: Front page at https://www.wsj.com/print-edition/20201201/frontpage
Found article: Moderna Asks Health Regulators to Authorize Its Covid-19 Vaccine
The drugmaker is seeking approval for its Covid-19 vaccine after it was shown to be 94.1% effective, keeping the shot on track for use in the U.S. by year’s end, alongside Pfizer and BioNTech.
Found article: Exxon Slashes Spending, Writes Down Assets
The struggling Texas oil giant is retreating from a plan to increase spending to boost its oil and gas production by 2025 and preparing to slash the book value of its assets by up to $20 billion.
Found article: General Motors Will No Longer Take a Stake in Nikola
The auto maker will no longer take an equity stake in the electric-truck maker under a stripped-down agreement, a significant retrenchment from an earlier pact that fueled investor enthusiasm for both companies.
Found article: The Franchise Relationship That Powers Small Business Is Fraying
At brands such as Subway and Econo Lodge, owners and store operators once pulled in the same direction but now increasingly squabble. It’s a worrisome trend for an industry that gives individuals a way to become their own boss and that employs more than 8 million in the U.S.
Found article: Seeking a Tranquil Retreat? Try a Japanese Laundromat
In an aging economy, laundromats are a bright spot, attracting customers with cafes and music; ‘Moody Dryer.’
Failed to find Whats News section
Found section: U.S. news at https://www.wsj.com/print-edition/20201201/us
Found article: Labor Department Published Flawed Estimates of Weekly Jobless Claims, Watchdog Says
The Government Accountability Office flagged inaccurate weekly claims tallies and lower-than-appropriate payouts to millions left jobless by the pandemic.
Found article: Powell Says Fed Actions Unlocked $2 Trillion to Support Economy
Federal Reserve Chairman Jerome Powell said the central bank’s actions to backstop a range of credit markets after the coronavirus convulsed Wall Street this past spring had unlocked almost $2 trillion to support businesses, cities and states.
Found article: Facebook, Google to Face New Antitrust Suits in U.S.
Big Tech’s legal woes are expected to worsen in the coming weeks as federal and state antitrust authorities prepare to file as many as four more cases targeting the tech giants by the end of January.
Found article: Government’s Lawyer Urges Justices to Delay Ruling on Census Plan
Several justices suggested the Supreme Court put off ruling on President Trump’s plan to exclude illegal immigrants from population figures used to apportion House seats—a move contested by Democratic-leaning states.
Found article: China Complains of U.S. Harassment of Chinese Airline and Ship Crews
Beijing said U.S. officials were conducting surprise raids on arriving vessels to question crews about Communist Party membership in an effort to “provoke ideological confrontation.”
Found article: Georgia Secretary of State Investigates Voting Groups but Denies Widespread Fraud
Brad Raffensperger said the state’s machine recount of the presidential race is on schedule to be completed by Wednesday, and pushed back against accusations of widespread fraud in the state’s Nov. 3 election results.
Found article: Arizona, Wisconsin Certify Narrow Victories for Biden
Two important battleground states certified election results, with Wisconsin and Arizona handing narrow victories to President-elect Joe Biden and further cementing his win over President Trump.
Found article: Coming Tuesday: An Idea Who Will Get First Covid-19 Vaccines
An expert panel advising the federal government on Covid-19 vaccines is expected Tuesday to recommend who should get the first supplies.
Found article: Trump Coronavirus Adviser Scott Atlas, Who Called for Ending Lockdowns, Resigns
Scott Atlas, a coronavirus adviser to President Trump who argued against lockdowns and sparred with health experts, has resigned.
Found article: Covid-19 Likely in U.S. in Mid-December 2019, CDC Scientists Report
The virus was in the U.S. a month earlier than previously recognized, according to a new CDC analysis of blood donations.
Found article: Here’s Where Biden Will Face Early Foreign-Policy Decisions
President-elect Biden faces early decisions on whether to undo a set of executive actions President Trump took on his own—on Iran, Afghanistan and climate change, among other topics.
Found article: Joe Biden Chooses Brian Deese as Top Economic Adviser
The president-elect Joe Biden picked the former adviser to Barack Obama to be the director of the National Economic Council, according to people familiar with the matter.
Found article: FCC Chairman Pai to Step Down, Giving Biden Clearer Path to Reshape Agenda
Federal Communications Commission Chairman Ajit Pai plans to leave the agency on Jan. 20, 2021, clearing the way for President-elect Joe Biden to select a new head of the telecommunications regulator.
Found article: OMB Pick Neera Tanden Draws GOP Fire
President-elect Joe Biden’s plan to nominate Neera Tanden to head the Office of Management and Budget is already stirring tensions on Capitol Hill, where Republicans say her past comments undercut the new president’s pledge to calm political waters.
Found section: World news at https://www.wsj.com/print-edition/20201201/world
Found article: Iran Nuclear Scientist Was Killed With ‘New Method,’ Tehran Says
The leading Iranian nuclear scientist killed Friday was ambushed in a remotely controlled operation, a top security official said at his funeral procession on Monday.
Found article: Lebanon’s Central Bank Fuels Corruption, Extremism Concerns
U.S. and other Western officials are exerting pressure on Lebanon’s central bank as part of a push to sideline Iran-backed Hezbollah, oppose corruption and alleviate the country’s economic and political crises.
Found article: Cuban Leadership Confronts a Rare Dissident Movement
An alliance of hip-hop musicians, writers, internationally known artists and Black activists has emerged as a driving force against censorship and government repression in Cuba.
Found article: Chinese ‘Wolf Warrior’ Diplomat Enrages Australia With Twitter Post
Australian Prime Minister Scott Morrison demanded an apology for the official’s use of an image showing an Australian soldier apparently threatening an Afghan child. Australia’s government says the photo is doctored.
Found article: In Europe’s Nursing Homes, a Soaring Covid-19 Death Toll and the Pain of Isolation
The coronavirus has resurged in Europe’s nursing homes, killing thousands of older people and forcing facilities to make a difficult choice: impose another period of crushing isolation or risk greater exposure to the virus.
Found section: Greater new york at https://www.wsj.com/print-edition/20201201/new-york
Found article: New York Instructs Hospitals to Prepare for Covid-19 Surge
Gov. Andrew Cuomo ordered hospitals in the state to increase their bed count and identify additional staff as the number of Covid-19 hospitalizations reached a level not seen since late May.
Found article: New York City Nurse Braces for New Covid-19 Surge. ‘Nobody Wants to Do It Again.’
Public-health experts expect the city’s new surge of Covid-19 infections won’t be as bad as the first. A nurse who leads a Covid-19 ward at a Manhattan hospital says the mood is anxious, but hopeful.
Found article: Rockefeller Center Limits Christmas Tree Viewings to 5 Minutes
Holiday revelers, take note: You can still see the Rockefeller Center Christmas Tree this year, but don’t plan on gazing for long.
Found article: Pandemic Cuts Foot Traffic in New York’s Top Business Districts
Manhattan’s Flatiron and Union Square neighborhoods thrived before Covid-19, with residents, office workers, tourists and students supporting shops and restaurants that are now struggling without many of them.
Found section: Life & arts at https://www.wsj.com/print-edition/20201201/lifearts
Found article: For Covid Long-Haulers, a Little-Known Diagnosis Offers Possible Treatments—and New Challenges
A disorder called POTS offers some treatment paths, but they are often arduous.
Found article: What Are the Health Risks of Disinfectants?
Disinfecting cleaners used against Covid-19 generally are safe, doctors and medical researchers say, but here’s what you need to know about potential health hazards.
Found article: This Doctor Elevated His Yoga Practice—20 Feet Off the Ground
A chance encounter with aerial silks helped Dr. Robert Sullivan build his core strength and overcome his fear of heights.
Found article: ‘Dimensional Stardust’ by Rob Mazurek Review: Futuristic Big-Band Sounds
The cornetist and composer leads his Exploding Star Orchestra on an album that deftly incorporates electronics into its rich, contrapuntal arrangements.
Found article: ‘Plastic Hearts’ by Miley Cyrus Review: Back to the Future
The star’s new album mines the sounds of the ’80s and tracks by artists like Billy Idol to craft a contemporary pop course in music history.
Found article: Hi, It’s the Denver Broncos. Can You Play Quarterback Tomorrow?
A coronavirus scramble thrusts an unknown into a starring role after the Broncos lose four quarterbacks. Now what happens with the Ravens and the Steelers game?
Found article: Meet the Mets: The Most Interesting Team in Baseball
While baseball retrenches in the wake of the pandemic, new Mets owner Steve Cohen appears ready to act aggressively.
Found section: Opinion at https://www.wsj.com/print-edition/20201201/opinion
Found article: Trump’s March to Atlanta
No one has a bigger stake in keeping the Senate Republican than the president.
Found article: Germany Won’t Take Portugal’s EU Split
Prime Minister Costa veils his plan with pretty words about European values.
Found article: Ancient History Isn’t Colonialism
Students at Brown nonsensically accuse Roman emperors of ‘white supremacy.’
Found article: ‘South to Freedom’ Review: México Libre
The little-told story of runaway slaves in Mexico, and of relations between the U.S. and its southern neighbor in the antebellum period.
Found article: How Biden Can Break the Senate Stonewall
Start with issues that cross party lines. For some ideas, look to November’s state ballot measures.
Found article: Media Treat Trump’s Team Like Dogs, Biden’s Like Puppies
The largely celebratory coverage unwittingly emphasizes the triumph of the press’s own class.
Found article: Fake Claims About Dominion Voting Systems Do Real Damage
Our machines have no secret ‘vote flipping’ algorithm. We have no ties to dictator Hugo Chávez.
Found article: Notable & Quotable: School’s Out
‘How to help kids understand why school inexplicably opens and closes.’
Found article: Return of the Obama Economists
Biden’s policy advisers were in charge during the secular stagnation years.
Found article: De Blasio Gets Schooled on Reopening
He reopens some schools as public pressure beats the teachers union.
Found article: Trump’s Fair Banking Rule
Pushing back against the left’s red-lining of unpopular industries.
Found article: Biden Brings Traditional Values to Diplomacy
America heads back to the future with a Biden-Harris reboot of Obama-Biden international agreements and alliances.
Found article: Remediating Student Debt’s Failing Grades
The expected taxpayer losses on student-loan debt highlight the disastrous consequence of shielding the higher-education industry from the loan losses incurred for its services.
Found article: Assassinations and Iran’s Nuclear Program
The assassination of an official of a U.N. member state in its territory is a dangerous game.
Found section: Business & finance at https://www.wsj.com/print-edition/20201201/business
Found article: Dow Falls but Holds On for Best Month in Over Three Decades
U.S. stocks declined but completed a banner November, giving the Dow Jones Industrial Average its best month in more than 33 years.
Found article: The Stock Market’s Rally Is Finally Widening
So far in November, 464 stocks in the S&P 500 have risen, the largest share for any month since April, as the gains in the U.S. market broaden out to include smaller companies as well as banks and the energy industry.
Found article: Zoom’s Pandemic-Fueled Boom Continues
The videoconferencing company posted another quarter of record sales and again lifted its outlook as remote working and distance schooling drags on during the pandemic.
Found article: Credit Suisse Spied on More Employees Than Previously Disclosed
Lawyers hired by Credit Suisse in the aftermath of a spying scandal last year found two earlier instances of employees being followed by private investigators, despite the bank’s assertions that it doesn’t condone physical surveillance.
Found article: S&P Upgrades Itself to Data Juggernaut With IHS Markit Deal
The company is already one of the world’s largest financial-data companies, and its proposed $44 billion deal for IHS Markit stands to solidify that position.
Found article: Tokyo Stock Exchange’s CEO Resigns Over Daylong Shutdown
Tokyo Stock Exchange head Koichiro Miyahara resigned Monday, two months after computer problems caused one of the world’s largest markets to halt trading for a full day.
Found article: Troubles in the Oil Patch: Low Prices to Lost Jobs
By some measures, the coronavirus pandemic hit the energy industry harder than any other major segment of the U.S. economy, and while crude prices have staged a rally recently, the sector is still going through one of the most brutal years in its history.
Found article: Facebook to Buy Kustomer, Startup Valued at $1 Billion
The social-media giant is buying Kustomer, which specializes in customer-service platforms and chatbots, as Facebook looks to promote its platforms as a way to do business.
Found article: OPEC Defers Decision on Extending Output Curbs
OPEC put off its decision about whether to extend oil output cuts until Thursday, when the cartel plans to meet with Russian-led producers.
Found article: Companies Urged to Adjust Hiring Requirements for Cyber Jobs
Companies need millions more cybersecurity professionals to fill roles around the world, but researchers say outlandish job requirements are the problem, rather than a lack of workers.
Found article: Amazon Makes Mac Commitment, Opening Door to Apple Developers
Tech giants Amazon and Apple are joining forces to support the growing number of companies developing apps and other software for Apple devices.
Found article: How NIO, a Chinese EV Startup, Rose, Fell and Rose Again
A year ago, Chinese electric-vehicle startup NIO was near ruin. Today it is worth more than General Motors.
Found article: The World’s Appetite for Debt Is Smashing Records
Companies and governments have issued a record $9.7 trillion of bonds and other debt this year, as extraordinary support from the Fed and other central banks has fueled a borrowing bonanza.
Found article: U.S. Banks Urged to Stop Using Libor on New Loans by End of 2021
U.S. regulators on Monday pressed banks to stop using the London interbank offered rate on new transactions by the end of 2021 while backing a plan to allow many existing transactions to mature before Libor fully winds down in June 2023.
Found article: Emissions Clampdown Sends Rhodium Prices on Explosive Rally
Rhodium prices are soaring to record highs, making the precious metal that helps to strip pollutants out of car fumes one of the best-performing commodities in 2020.
Found article: The Market Expects That Everything Will Be Awesome
Even if things go well with vaccines and the economy, there may be no particular reason for stock prices to change.
Found article: Bitcoin Price Hits All-Time High Above $19,000, Topping 2017 Record
Bitcoin surged Monday to set its first fresh record in nearly three years, driven by a wave of new investors lured by the potential for big profits.
Found article: Extended Stay America Is a Pandemic Sleeper Hit
The lodging chain has outperformed peers and should continue to do well despite a subdued holiday season.
Found article: Driver Data Is a Help and a Hazard for Auto Insurers
Real-world driving data from connected cars is both a treasure trove and a mine-field for auto insurers. Big banks’ efforts to deal with financial technology challengers offer some useful lessons.
Found article: Hong Kong’s Bankless Leader Reveals the Long Arm of the U.S. Treasury
Secondary sanctions, applied to institutions that deal with individuals targeted by the U.S. government, are powerful weapons that international lenders fear.
Found article: A Fine Payoff for Reading the Ingredients
Companies are being hit with lawsuits by people who claim not to have read the packaging.
Found article: China’s Sour Grapes Spell Trouble for Australian Wine
Australian wine is the latest commodity in Beijing’s crosshairs, leaving companies like Treasury Wines with few palatable options.
Synthesizing mastheadImage
Fetching https://www.wsj.com/articles/moderna...p_wsj&ru=yahoo
Fetching https://www.wsj.com/articles/seeking...p_wsj&ru=yahoo
Fetching https://www.wsj.com/articles/exxon-s...p_wsj&ru=yahoo
Fetching https://www.wsj.com/articles/gm-niko...p_wsj&ru=yahoo
Fetching https://www.wsj.com/articles/the-fra...p_wsj&ru=yahoo
Fetched https://www.wsj.com/articles/seeking...p_wsj&ru=yahoo in 0.197941 seconds
Fetched https://www.wsj.com/articles/the-fra...p_wsj&ru=yahoo in 0.250730 seconds
Parsed https://www.wsj.com/articles/seeking...p_wsj&ru=yahoo in 0.1 seconds
Processing images...
Fetching https://si.wsj.net/public/resources/...1130101527.jpg
Parsed https://www.wsj.com/articles/the-fra...p_wsj&ru=yahoo in 0.1 seconds
Processing images...
Fetching https://images.wsj.net/im-265632?width=620&size=1.5
Fetched https://www.wsj.com/articles/exxon-s...p_wsj&ru=yahoo in 0.320887 seconds
Fetched https://si.wsj.net/public/resources/...1130101527.jpg in 0.161467 seconds
Parsed https://www.wsj.com/articles/exxon-s...p_wsj&ru=yahoo in 0.1 seconds
Processing images...
Fetching https://images.wsj.net/im-266430?width=620&size=1.5
Fetched https://www.wsj.com/articles/moderna...p_wsj&ru=yahoo in 0.448331 seconds
Fetched https://www.wsj.com/articles/gm-niko...p_wsj&ru=yahoo in 0.458602 seconds
Fetched https://images.wsj.net/im-265632?width=620&size=1.5 in 0.156857 seconds
Fetched https://images.wsj.net/im-266430?width=620&size=1.5 in 0.112553 seconds
Parsed https://www.wsj.com/articles/moderna...p_wsj&ru=yahoo in 0.2 seconds
Processing images...
Skipping invalid link: mailto:christopher.matthews@wsj.com
Recursion limit reached. Skipping links in https://www.wsj.com/articles/exxon-s...p_wsj&ru=yahoo
Fetching https://images.wsj.net/im-265875?width=620&size=1.5
Parsed https://www.wsj.com/articles/gm-niko...p_wsj&ru=yahoo in 0.2 seconds
Processing images...
Fetching https://images.wsj.net/im-265886?width=620&size=1.5
Fetching https://images.wsj.net/im-265380?width=620&size=1.5
Fetching https://images.wsj.net/im-265624?width=620&size=1.5
https://www.wsj.com/articles/exxon-s...p_wsj&ru=yahoo saved to /private/var/folders/vv/h8jjxczd3tl94vvx0fcd5cc80000gn/C/calibre_5.6.0_tmp_lnh28vjg/gm0hj8kd_plumber/feed_0/article_1/index.xhtml
Fetching https://www.wsj.com/articles/labor-d...p_wsj&ru=yahoo
Fetched https://images.wsj.net/im-265875?width=620&size=1.5 in 0.070496 seconds
Downloaded article: Exxon Slashes Spending, Writes Down Assets from https://www.wsj.com/articles/exxon-s...p_wsj&ru=yahoo
Fetching https://images.wsj.net/im-265835?width=620&size=1.5
Fetched https://images.wsj.net/im-265886?width=620&size=1.5 in 0.084849 seconds
Fetched https://images.wsj.net/im-265624?width=620&size=1.5 in 0.090975 seconds
Fetched https://images.wsj.net/im-265380?width=620&size=1.5 in 0.097097 seconds
Skipping invalid link: mailto:ben.foldy@wsj.com
Skipping invalid link: mailto:mike.colias@wsj.com
Skipping invalid link: mailto:Ben.Foldy@wsj.com
Skipping invalid link: mailto:Mike.Colias@wsj.com
Recursion limit reached. Skipping links in https://www.wsj.com/articles/gm-niko...p_wsj&ru=yahoo
Fetched https://images.wsj.net/im-265835?width=620&size=1.5 in 0.073686 seconds
https://www.wsj.com/articles/gm-niko...p_wsj&ru=yahoo saved to /private/var/folders/vv/h8jjxczd3tl94vvx0fcd5cc80000gn/C/calibre_5.6.0_tmp_lnh28vjg/gm0hj8kd_plumber/feed_0/article_2/index.xhtml

08-29-2020, 02:49 PM	#10
akakindleuser Junior Member Posts: 1 Karma: 10 Join Date: Aug 2020 Device: kindle paperwhite	I am having the same issue as duluoz with the WSJ. My username and password for the WSJ seem correct but Calibre is giving me a "Failed Fetch news from The Wall Street Journal" error. This using the subscription and not 'free' 'Fetch News' option. Another thing, I don't think this is related but I saw on other pages something about the https://www.wsj.com/digital-print-edition?mod=wsjheader page being devoid of content. I noticed that they have an ereader version you can click on from that page, I don't know if calibre can pull from that page but it seems like that's the version you would want to download if you could. http://ereader.wsj.net/?editionStart...Street+Journal Spoiler: Fetch news from The Wall Street Journal Conversion options changed from defaults: output_profile: u'kindle_pw3' verbose: 2 Resolved conversion options calibre version: 4.23.0 {'asciiize': False, 'author_sort': None, 'authors': None, 'base_font_size': 0, 'book_producer': None, 'change_justification': u'original', 'chapter': None, 'chapter_mark': u'pagebreak', 'comments': None, 'cover': None, 'debug_pipeline': None, 'dehyphenate': True, 'delete_blank_paragraphs': True, 'disable_font_rescaling': False, 'dont_compress': False, 'dont_download_recipe': False, 'duplicate_links_in_toc': False, 'embed_all_fonts': False, 'embed_font_family': None, 'enable_heuristics': False, 'expand_css': False, 'extra_css': None, 'extract_to': None, 'filter_css': None, 'fix_indents': True, 'font_size_mapping': None, 'format_scene_breaks': True, 'html_unwrap_factor': 0.4, 'input_encoding': None, 'input_profile': <calibre.customize.profiles.InputProfile object at 0x0000025DB40CB248>, 'insert_blank_line': False, 'insert_blank_line_size': 0.5, 'insert_metadata': False, 'isbn': None, 'italicize_common_cases': True, 'keep_ligatures': False, 'language': None, 'level1_toc': None, 'level2_toc': None, 'level3_toc': None, 'line_height': 0, 'linearize_tables': False, 'lrf': False, 'margin_bottom': 5.0, 'margin_left': 5.0, 'margin_right': 5.0, 'margin_top': 5.0, 'markup_chapter_headings': True, 'max_toc_links': 50, 'minimum_line_height': 120.0, 'mobi_file_type': u'old', 'mobi_ignore_margins': False, 'mobi_keep_original_images': False, 'mobi_toc_at_start': False, 'no_chapters_in_toc': False, 'no_inline_navbars': True, 'no_inline_toc': False, 'output_profile': <calibre.customize.profiles.KindlePaperWhite3Outpu t object at 0x0000025DB40D1A88>, 'page_breaks_before': None, 'personal_doc': u'[PDOC]', 'prefer_author_sort': False, 'prefer_metadata_cover': False, 'pretty_print': False, 'pubdate': None, 'publisher': None, 'rating': None, 'read_metadata_from_opf': None, 'remove_fake_margins': True, 'remove_first_image': False, 'remove_paragraph_spacing': False, 'remove_paragraph_spacing_indent_size': 1.5, 'renumber_headings': True, 'replace_scene_breaks': u'', 'search_replace': None, 'series': None, 'series_index': None, 'share_not_sync': False, 'smarten_punctuation': False, 'sr1_replace': u'', 'sr1_search': u'', 'sr2_replace': u'', 'sr2_search': u'', 'sr3_replace': u'', 'sr3_search': u'', 'start_reading_at': None, 'subset_embedded_fonts': False, 'tags': None, 'test': False, 'timestamp': None, 'title': None, 'title_sort': None, 'toc_filter': None, 'toc_threshold': 6, 'toc_title': None, 'transform_css_rules': None, 'unsmarten_punctuation': False, 'unwrap_lines': True, 'use_auto_toc': False, 'verbose': 2} InputFormatPlugin: Recipe Input running Downloading recipe urn: builtin:wsj Trying to get latest version of recipe: wsj Using user agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/73.0.3683.86 Safari/537.36 Starting login process... Sending login request... Performing login callback... Python function terminated unexpectedly Failed to login (callback URL failed), check username and password (Error Code: 1) Traceback (most recent call last): File "site.py", line 114, in main File "site.py", line 88, in run_entry_point File "site-packages\calibre\utils\ipc\worker.py", line 209, in main File "site-packages\calibre\gui2\convert\gui_conversion.py", line 36, in gui_convert_recipe File "site-packages\calibre\gui2\convert\gui_conversion.py", line 28, in gui_convert File "site-packages\calibre\ebooks\conversion\plumber.py", line 1110, in run File "site-packages\calibre\customize\conversion.py", line 246, in __call__ File "site-packages\calibre\ebooks\conversion\plugins\recipe_ input.py", line 138, in convert File "site-packages\calibre\web\feeds\news.py", line 904, in __init__ File "<string>", line 153, in get_browser ValueError: Failed to login (callback URL failed), check username and password If anyone knows what to do to get this to work, thank you in advance!

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Wall Street Journal (WSJ) recipe broken	Hellman101	Recipes	10	02-06-2017 03:24 PM
Wall Street Journal (free) is broken	NSILMike	Recipes	2	11-29-2014 03:47 PM
Wall Street Journal recipe broken?	nisew	Recipes	2	09-28-2011 05:08 PM
Wall Street Journal, WSJ, Free version, recipe improvement for full text of all ar	winterescape	Recipes	16	02-07-2011 01:51 PM
Wall Street Journal	dieterpops	Sony Reader	0	12-20-2009 05:51 PM

06-03-2020, 12:23 AM	#2
kovidgoyal creator of calibre Posts: 45,253 Karma: 27110894 Join Date: Oct 2006 Location: Mumbai, India Device: Various	Works fine for me, and no one else has reported issues either. Check your subscription status.

07-05-2020, 07:41 AM	#4
kovidgoyal creator of calibre Posts: 45,253 Karma: 27110894 Join Date: Oct 2006 Location: Mumbai, India Device: Various	That's likely a bug on the website, if you go to https://www.wsj.com/print-edition/20200704/frontpage its largely empty, you should report it to the wsj and hopefully they will fix it.

07-06-2020, 05:39 PM	#7
modelstudent101 Junior Member Posts: 4 Karma: 10 Join Date: Jul 2020 Device: Oasis	Update on the issue re: unhashable type error. Only occurs with WSJ.recipe, and not WSJ_FREE.recipe - appears to be an issue with the login process. WSJ_FREE.recipe works perfectly fine, but it appears that there's a hangup after sending login information - happens in both command line and GUI.

07-06-2020, 11:20 PM	#8
kovidgoyal creator of calibre Posts: 45,253 Karma: 27110894 Join Date: Oct 2006 Location: Mumbai, India Device: Various	@modelstudent101: Linux distro packages of calibre are not supported. Use the official calibre binaries and you will be fine.

07-07-2020, 06:01 PM	#9
modelstudent101 Junior Member Posts: 4 Karma: 10 Join Date: Jul 2020 Device: Oasis	@kovidgoyal - Ahhh okay, unfortunately the binaries aren't supported on ARM and I'm not running ARCH. Not that difficult for me to run on the desktop. Thanks for everything you do and creating/maintaining such an amazing resource.

Advert

Advert