v0.11.9

0.11.9 (2024-09-20)

High level features

• Firecrawl doc searcher

Features

• add analytics link to playgrounds (3927f7c)
• add building something (696820a)
• add code examples (e8b7252)
• add copy button to chat (c35406d)
• add copy id button (75f218a)
• add created at sort in rag (7ad2d4d)
• add delete chunks flag to delete file route (3981811)
• add docker file and CI action to build scrape-worker (46039ca)
• add firecrawl to our docker compose (97deaa5)
• add org user page (806347c)
• add usage (863b7de)
• api keys (119b03d)
• api keys page (ffab74c)
• better api keys table (e8958fd)
• better sidebar (2fcbdf9)
• billing pages (c59da55)
• chunk on headings (1fde18a)
• consistent dataset context (aba6ed4)
• create org (c28a002)
• dataset overview (0cac1ab)
• dataset settings (7430e94)
• dataset sidebar with selector (9d2721a)
• dedup if url and page are the same (fdda50f)
• even better context (93e2b96)
• events page (887623e)
• fill in missing dates on graphs (2eca588)
• fix typo issues (590d808)
• fix usage (7de702a)
• included cron job in order to facilitate auto-scrapes (09edbae)
• init new console (daaa8fc)
• magic suspense (cc64d0a)
• magicbox (6e695a7)
• more magic box props (a845615)
• more on dataset homepage (f19c316)
• move crawl setting to dataset level (ae054f5)
• move to html chunking (51de3e1)
• move to polling firecrawl from webhook (649cb0b)
• new data explorer table (c350a5a)
• new dataset overview (90418e9)
• new tables for rag queries (48112ee)
• on update, create crawl if not exist (c844bba)
• org layout (6b9e07a)
• org settings page (d7c84de)
• org switching (dab332f)
• python client (5e864ee)
• redo table in no search query (dad2340)
• redo tables in search analytics (bbd7255)
• refactor user and invite tables (3f2494d)
• set up scrape worker with endpoint to crawl (0b472c2)
• set up semantic and full text boost for headings (332cd7c)
• simplify new org creation (fc677f4)
• update modal in data explorer (7c207a9)
• working dataset settings (79db3de)

Cleanup

• better CSS scoping for search component (87e847a)
• change default prompt such that LLM does not provide citations by default (6878f85)
• fix 2x typos of 'likeclickthrough' (4041788)
• improve pypi page for python sdk client (cd20b77)
• move towards html output from firecrawl (56f5c2b)
• properly handle fallback types for redis for Rust '24 version (6e14d18)
• put port back (1f21b1e)
• remove extra file (56da639)
• remove tooltip and globe icons (5831b53)
• update docker compose .env to include firecrawl (5404c91)
• update readme (aa46afb)

Bug Fixes

• add better margins to headings (868bc7c)
• add delete invitation to openapi spec (7a2b4c0)
• add get invitations to openapi spec (5f33336)
• auth edge cases (73b888d)
• concate short chunks to next one (d4dd68d)
• dataset warning for chat (82b8f21)
• ensure that dataset that is scrape to is the new dataset that is created (366380b)
• fill empty dates in rag usage chart (2537a6d)
• firecrawl scraping logic next behavior solve (c5103ab)
• fix copy feature to allow for plain text in chat (f4f2a2c)
• fix user cache flashing org select (505b5d8)
• no datasets warning for chat (04a7775)
• only open modal when there are results (d93b9ef)
• openapi schema issues w/ dup def for /invitation/{foo} (67af1f8)
• remove fake delay from testing (ead31c4)
• remove TR-Dataset requirement for create dataset (790c3a9)
• set topic list to empty if dataset is invalid (b958ed6)
• show all info in the no results table (36c948e)
• wait for firecrawl if scraping (bf4f298)

Docs

• fix getting started README docs (6410745)
• improve start services and add tmuxp to README local Dev guide (2473c0a)