Hi to everyone,
I’m experiencing a query execution time dropdown when i request results with high offset.
If i have a ~600k documents where each document has around 9 keys and each key has a value that is a string and with average size of 10 and there is no further object nesting.
I created the index like following:
FT.CREATE name_index ON JSON SCHEMA $.name AS name TAG SORTABLE
The following query is executed really fast (40ms):
FT.SEARCH name_index * SORTBY name ASC
But when i try to fetch near the end, it’s being executed in 3.5 seconds
FT.SEARCH name_index * LIMIT 599990 10 SORTBY name ASC TIMEOUT 5000
When i’m using the profiler in RedisInsight, it says that sorting takes around 200ms, and pager/limiter takes around 90% of the execution.
Any advice how to make it a bit more performant if even possible?
Thanks in advance.