Parasail raises $32M for its pay-per-token inference cloud

Artificial intelligence infrastructure startup Parasail Inc. today announced that it has raised $32 million in funding.
InfoQ

Google’s TurboQuant Compression May Support Faster Inference, Same Accuracy on Less Capable Hardware

Google Research unveiled TurboQuant, a novel quantization algorithm that compresses large language models’ Key-Value caches ...