fromHackernoon2 days agoEffective Data Chunking and Querying with Pinecone and GPT-4o | HackerNoonTo improve data quality for ingestion into Pinecone, markdown was preprocessed to remove images, dividers, and excess whitespace, enhancing readability and relevance.Data science