This is great! I would love an explicit "set bookmark to here" button if I scroll up from the high watermark
I discovered the reset, but it took a minute and I expect given the way I read being able to explicitly walk the high watermark back a bit would be nice (maybe that's doable if you select text? I didn't try!)
The format is nice, I love standard ebooks
I opened Moby Dick but didn't see how to listen to it on my phone, not sure what the status of the "listen" effort is.
I listened to some books from standard ebooks using eleven labs, but I'm really excited about a better implementation
samuelcole 46 minutes ago [-]
moby dick didn't align properly, there's a confidence gate it didn't pass.
i know, it makes me sad too, i'll keep working on it
librivox is all human volunteers, so i think it makes a difference from eleven labs, but i might add a fallback to ai readings for folks who want that
reset feedback noted!
p-e-w 37 minutes ago [-]
> moby dick didn't align properly, there's a confidence gate it didn't pass.
What does this mean?
samuelcole 25 minutes ago [-]
well! (i've been waiting for someone to ask ha)
when i first knew i wanted to align audio to text, i reached for aeneas, which was built for this exact problem/product (https://www.readbeyond.it/aeneas/)
however, it drifted by hundreds of seconds deep into chapters and emits no confidence signal, so i couldn't eval it cleanly
so i switched to a neural acoustic model trained with ctc (meta's massively multilingual speech aligner, it ships inside torchaudio): it outputs a probability for each character at every frame of audio, and viterbi decoding finds the most probable path that spells exactly our text, with a per-word probability
that probability is the gate: a book ships read-along only if its median confidence and coverage clear a bar. moby dick's didn't, so it's honestly text-only
khanhnguyen8386 11 minutes ago [-]
Forced alignment using CTC over LibriVox recordings to sync text and audio is a brilliant use of compute. Whispersync for the open web—love it!
mplanchard 55 minutes ago [-]
Unrelated, but all I want is a letterboxd for books, with the light social aspect, the ability to log a read multiple times, and with a great interface. I read my hope for this into the title of this post, unfortunately.
That would be nice. Wonder if there'll be such a service with the federated small web. Good reads is too heavy on the social aspect for my taste.
I used LibraryThing a bit ago, but now I have a note with a list of books I add to regularly.
samuelcole 48 minutes ago [-]
do you think there's space for that? i really wanted to build that too, but there is already goodreads, fable, storygraph, bookly, etc
nor0x 48 minutes ago [-]
have you seen https://literal.club ? For me it works quite well, i can log my reads there and can follow accounts of friends who have a good book taste
samuelcole 2 hours ago [-]
i've been building this over the last two weeks, it first started as a reader for standard ebooks (https://standardebooks.org/), with clean typography, progress tracking, and nice deep linking (try clicking on a paragraph to create a mark and copy it to your clipboard)
but i think i really unlocked something when i discovered the amazing recordings on https://librivox.org, i've been spending the last few days frying my macbook's gpu to do neural alignment so that you can sync an audiobook with its text counterpart, to make switching between the text and the audio seamless
it's a ctc forced-alignment over the whole audiobook, keyed to the same paragraph anchors i used for progress tracking and linking
i think it's really cool? let me know
ragtagtag 39 minutes ago [-]
This looks lovely, thank you. Is there a source repository available?
samuelcole 19 minutes ago [-]
not right now! i'm still deciding what i want to do with this
tbh, the most exciting thing is the aligner, i might extract that into an open source project... that's a good idea
deviation 1 hours ago [-]
Fantastic. Have you considered supporting other languages, too? Such as French?
samuelcole 50 minutes ago [-]
the aligner already supports french (it's meta's massively multilingual speech model under the hood), so it would all work today, but i started on standard ebooks, which is english-only.
but gutenberg and librivox both have french libraries so i could absolutely do that next!
gabriel666smith 20 minutes ago [-]
Really nice. I think we might have similar backgrounds. Say hi sometime if you like.
Feedback:
I couldn't work out how to begin audio - it didn't autoplay in Arc (which might block autoplay) but then maybe is also be hiding some sort of audio control. Scroll didn't seem to trigger it.
Actually, after mucking around hard refreshing trying to work out what I'm meant to click after the thing that was meant to carry stuff between devices, A play button did appear. Not sure if it was there and I was being dense (UI feedback), or if it wasn't there.
Actually, I had the old tab open still, and there's no play button there. Guess I had to interact with some element or something.
I can't work out how to sign up, unless it's the field that looks like it's to follow you specifically?
Stuff I've thought about around this:
1. Add global user highlighting of passages + commenting, upvoteable, a la (rap) genius. Work out how to get an LLM to scrape existing criticism to hyperlink that stuff.
2. Add a function that allows users to search and pull files from a remote location to their local device. Let users work out they can point it at Anna's Archive / libgen / wherever. Probably plausibly deniable (official legal advice). This feature would make me actually use this. ISBN is a pretty good uniqueifier.
The publishing world really needs disruption - I don't think it will stop using its weird legacy rights laws (which are extremely hostile to readers) without a shove.
3. I believe, legally, Amazon is able to get away with its TTS function being a shit audiobook without you having to separately purchase an audiobook by calling it an 'accessibility feature', and ensuring the file generated is a single use thing. Seems like an open goal with how low-power TTS models are becoming.
4. Integrate old longform criticism from LRB etc, and new criticism as it is published. It's insane those archives exist, and all books are online, but I can't currently move between stuff using hyperlinks. Criticism should probably be the same data category and treated the same as user comments / reviews / whatever of work, with a 'somebody cared enough to pub this' tag. Integrating new crit alongside comments from your friends gives you a 'feed' type view.
5. I don't care at all about reading user-written fiction. Wattpad etc exist for non-literary-fiction stuff, there's a whole ecosystem of tiny journals for lit fic. I do really care that books are the only commercial form (unlike movies, music) that didn't move from difficult piracy -> kind of piracy -> legit easy access to a reasonable amount of media.
I hope someone sorts that, ideally in a way that is non-destructive in the long term - but I personally believe "the Popcorn Time of Anna's Archive" existing is net-beneficial to humanity even with authors & editors never getting paid.
samuelcole 7 minutes ago [-]
you wrote brat! i 'own' your book (on kindle, ha, so i'm not sure if that counts as real ownership), and it's on my to-read pile
anyways, i'm going to send you an email
i filed tickets for myself for the play button weirdness, thanks for including the browser, it might be related, and the product feedback around sign up (i didn't want to be too pushy, maybe went too far in the other direction)
for your thinking:
global user highlighting is basically half-done: tap any paragraph to leave a note, however the only way to share that note is with links... tale.fyi needs some way to discover other people's notes. did you ever play dark souls?
i also like integrating other forms of criticism from around the web, hmmm
you don't care about user-written fiction? interesting from you, since you know all the mechanics... is it because it's unedited basically? like when does fiction cross from user-generated to commercial? is it curation?
I guess you don't tread the same internet waters.
https://www.royalroad.com/home https://archiveofourown.org/ and the good old link rings like https://topwebfiction.com/
i'm mostly reacting to the default thing that people scroll are reddit, facebook, instagram, ahem hn
which are all non-fiction... i wanted to build something easy to scroll in line at the grocery store that was fiction
First impression: autoplay of noisy audio when you go to a book is awful. Please don't do this.
> Humanity has a massive corpus of fiction, thanks to copyright law...
Seems a strange thing to credit first.
https://tale.fyi/tell says you need to sign in to tell your own story, but there doesn't seem to be a way to do that (I'm on Firefox Android).
good catch, thanks
I discovered the reset, but it took a minute and I expect given the way I read being able to explicitly walk the high watermark back a bit would be nice (maybe that's doable if you select text? I didn't try!)
The format is nice, I love standard ebooks
I opened Moby Dick but didn't see how to listen to it on my phone, not sure what the status of the "listen" effort is.
I listened to some books from standard ebooks using eleven labs, but I'm really excited about a better implementation
i know, it makes me sad too, i'll keep working on it
this is the list of everything: https://tale.fyi/audiobooks
librivox is all human volunteers, so i think it makes a difference from eleven labs, but i might add a fallback to ai readings for folks who want that
reset feedback noted!
What does this mean?
when i first knew i wanted to align audio to text, i reached for aeneas, which was built for this exact problem/product (https://www.readbeyond.it/aeneas/)
however, it drifted by hundreds of seconds deep into chapters and emits no confidence signal, so i couldn't eval it cleanly
so i switched to a neural acoustic model trained with ctc (meta's massively multilingual speech aligner, it ships inside torchaudio): it outputs a probability for each character at every frame of audio, and viterbi decoding finds the most probable path that spells exactly our text, with a per-word probability
that probability is the gate: a book ships read-along only if its median confidence and coverage clear a bar. moby dick's didn't, so it's honestly text-only
It uses ActivityPub, so you interact with Mastodon and stuff, if you are into that.
If you want to join the beta, just email me at ben@bookdna.com. We've got about 100 people using it right now.
We are working on goodreads/storygraph imports, and then adding folders. It already supports multiple reads and more.
https://clz.com/books
I used LibraryThing a bit ago, but now I have a note with a list of books I add to regularly.
but i think i really unlocked something when i discovered the amazing recordings on https://librivox.org, i've been spending the last few days frying my macbook's gpu to do neural alignment so that you can sync an audiobook with its text counterpart, to make switching between the text and the audio seamless
it's a ctc forced-alignment over the whole audiobook, keyed to the same paragraph anchors i used for progress tracking and linking
i think it's really cool? let me know
tbh, the most exciting thing is the aligner, i might extract that into an open source project... that's a good idea
but gutenberg and librivox both have french libraries so i could absolutely do that next!
Feedback:
I couldn't work out how to begin audio - it didn't autoplay in Arc (which might block autoplay) but then maybe is also be hiding some sort of audio control. Scroll didn't seem to trigger it.
Actually, after mucking around hard refreshing trying to work out what I'm meant to click after the thing that was meant to carry stuff between devices, A play button did appear. Not sure if it was there and I was being dense (UI feedback), or if it wasn't there.
Actually, I had the old tab open still, and there's no play button there. Guess I had to interact with some element or something.
I can't work out how to sign up, unless it's the field that looks like it's to follow you specifically?
Stuff I've thought about around this:
1. Add global user highlighting of passages + commenting, upvoteable, a la (rap) genius. Work out how to get an LLM to scrape existing criticism to hyperlink that stuff.
2. Add a function that allows users to search and pull files from a remote location to their local device. Let users work out they can point it at Anna's Archive / libgen / wherever. Probably plausibly deniable (official legal advice). This feature would make me actually use this. ISBN is a pretty good uniqueifier.
The publishing world really needs disruption - I don't think it will stop using its weird legacy rights laws (which are extremely hostile to readers) without a shove.
3. I believe, legally, Amazon is able to get away with its TTS function being a shit audiobook without you having to separately purchase an audiobook by calling it an 'accessibility feature', and ensuring the file generated is a single use thing. Seems like an open goal with how low-power TTS models are becoming.
4. Integrate old longform criticism from LRB etc, and new criticism as it is published. It's insane those archives exist, and all books are online, but I can't currently move between stuff using hyperlinks. Criticism should probably be the same data category and treated the same as user comments / reviews / whatever of work, with a 'somebody cared enough to pub this' tag. Integrating new crit alongside comments from your friends gives you a 'feed' type view.
5. I don't care at all about reading user-written fiction. Wattpad etc exist for non-literary-fiction stuff, there's a whole ecosystem of tiny journals for lit fic. I do really care that books are the only commercial form (unlike movies, music) that didn't move from difficult piracy -> kind of piracy -> legit easy access to a reasonable amount of media.
I hope someone sorts that, ideally in a way that is non-destructive in the long term - but I personally believe "the Popcorn Time of Anna's Archive" existing is net-beneficial to humanity even with authors & editors never getting paid.
anyways, i'm going to send you an email
i filed tickets for myself for the play button weirdness, thanks for including the browser, it might be related, and the product feedback around sign up (i didn't want to be too pushy, maybe went too far in the other direction)
for your thinking:
global user highlighting is basically half-done: tap any paragraph to leave a note, however the only way to share that note is with links... tale.fyi needs some way to discover other people's notes. did you ever play dark souls?
i also like integrating other forms of criticism from around the web, hmmm
you don't care about user-written fiction? interesting from you, since you know all the mechanics... is it because it's unedited basically? like when does fiction cross from user-generated to commercial? is it curation?