This unfortunately can't be done as-is because of the sort()
functionality: in order to correctly recreate the reference
point for the subsequent query we need to also serialize the
`fields` field from the FieldDoc result and that's an
Object[] (in our case it's always floats, but the api doesn't
guarantee this).