Thanks both for sharing, this is really useful feedback! I’ll add a little to what Jon says.
For your images Amelia: I’ve had a look through the logs and the transcription jobs were technically successful (i.e. no software bugs), but the AI failed to return text in a large proportion of your images. I see that your images are mostly or entirely printed text – I believe what’s going on here is that Leo has been optimised to extract handwriting from images and, when presented with printed text, acts inconsistently (sometimes ‘decides’ at the get-go to transcribe only the handwriting in your image, which is nothing). This is definitely not intended behaviour – in the next AI model release we’ll encourage it to transcribe both printed and handwritten text. The next AI model release should be relatively soon, but we don’t have a scheduled date yet. We’ll keep you posted on this via announcements on this forum.
For your images Noah: it looks like your manuscripts are in German and you’ve seen a mix of some blank transcripts and at least one repetitive hallucination. This is generally a sign that the model is struggling because the manuscripts are a little outside its comfort zone compared with what it’s been trained on. We’re working on increasing the model’s accuracy outside of English, so watch this space – we’ll keep you apprised of developments on this again via annoucements.
Thanks again!