Ad

Tuesday, 2 July 2024

New top story on Hacker News: Show HN: I Made an Open Source Platform for Structuring Any Unstructured Data

Show HN: I Made an Open Source Platform for Structuring Any Unstructured Data
27 by adithya-s-k | 7 comments on Hacker News.
Hey HN, I'm Adithya, a 20-year-old dev from India. I have been working with GenAI for the past year, and I've found it really painful to deal with the many different forms of data out there and get the best representation of it for my AI applications. That's why I built OmniParse—an open-source platform designed to handle any unstructured data and transform it into optimized, structured representations. Key Features: - Completely local processing—no external APIs - Supports ~20 file types - Converts documents, multimedia, and web pages to high-quality structured markdown - Table extraction, image extraction/captioning, audio/video transcription, web page crawling - Fits in a T4 GPU - Easily deployable with Docker and Skypilot - Colab friendly with an interactive UI powered by Gradio Why OmniParse? I wanted a platform that could take any kind of data—documents, images, videos, audio files, web pages, and more—and make it clean and structured, ready for AI applications. Check it out on GitHub: https://ift.tt/5Mt9vY4

No comments:

Post a Comment