The semantic chunker (chunking strategy) creates chunks based on semantic similarity.
Using the model defined in the URL request, the semantic chunker splits text into sentences, encodes the sentences, and then compares the sentence to the building chunk to determine if they are similar enough to group together.
After merging two semantically-similar sentences into a pre-chunk, the semantic chunker needs to encode it to get its vector to compare with the next sentence vector.
This chunker is the slowest of all of the chunkers even if you set the approximate
field to true.
The authentication and authorization access token.
application/json
"application/json"
Unique identifier for the model.
"gte-small"
OK
This is the response to the POST chunking request submitted for a specific chunker
and modelId
.