Skip to content

About

The HackerNewsLetter Paper

Topics

Resources

Stars

5 stars

Watchers

1 watching

Forks

Repository files navigation

hackernewspaper

This is the hackernewsletter but in the format of a magazine, a pdf edition. Well, at least I tried to look like a magazine 😄 The latex based pdf contains the hackernewsletter edition including the categories, screenshots of all the url's, some metadata, and the 'gather' text from the url, but don't expect too much of the text sofar.

As an example: HackerNewsPaper-667. All the hackernewspaper editions can be found here, in the releases of this repo.

Motivation

I ❤️ the hackernewsletter. But I also cannot remember the links I've already opened, viewed, readed, watched. Only the name of the link in the email is not enough (for me..) to memorize what i've seen and not. But I do remember, as soon as the page opens in the browser, at that moment, i can exactly recall most of it. I just wanted to have a quicker overview of the newsletter. And the screenshots of the url's helps me achieve this.

But ended up with much more....

Screenshots

I use playwright to generate screenshots of the links (and to download their html). YouTube links use the YouTube Data API thumbnail and description when a YOUTUBE_API_KEY is set, otherwise they get a screenshot too.

Running locally

Python 3.11+ and Tectonic are needed.

python -m venv .venv
.venv/bin/pip install -r requirements.txt -r requirements-dev.txt   # Windows: .venv\Scripts\pip
.venv/bin/playwright install chromium
.venv/bin/python generator.py 814     # writes output.tex, caches downloads in dist/814/
tectonic -X compile output.tex        # writes output.pdf
.venv/bin/python -m pytest            # parser and handler tests, no network needed

In GitHub Actions the main.yml workflow builds every missing edition daily, a single one can be (re)built with the edition input of a manual run. See docs/FINDINGS.md and docs/PLAN.md for known issues and the roadmap.

Credits

Praise and credits for Kale Davis, as he is doing all the hard work of handpicking/organizing the articles each week. If you like this hackernewspaper, please also subscribe to the original hackernewsletter at hackernewsletter.com! Disclaimer: Hackernewsletter and Hackernewspaper are not affiliated with Y Combinator in any way.

Want to help?

I'm not a Latex expert. And there are also a lot of nice to have refinements to think of:

  • Parsing the top content (some times Kale leaves a message) on the top of his newsletter, is not done.
  • Parsing the sponsor content is sometimes off.. (empty sponsor sections are dropped)
  • Nicer output , more layouts in the template
  • Solve the GDPR Cookie problems on some screenshot.
  • Better text formatting. Maybe with the help of a LLM?
  • For non-html links, devise another method to generate a screenshot and extract text and metadata. The link in the newsletter is not always pointing to html content (think of direct links to MP4 files, PDF files, etc. )
  • [X/50%] In case of YouTube / Vimeo url's , get the duration as metadata + description from the platform. Which requires a Youtube Video API v3 key...

About

The HackerNewsLetter Paper

Topics

Resources

Stars

5 stars

Watchers

1 watching

Forks

Releases

Packages

Used by

Contributors

Languages