AIlisting.ai

GGML
(0)
0.0/5
(0)
0.0/5
What is GGML?
GGML is a machine learning tensor library designed for large models and high performance, featuring 16-bit float support and more.
Free
Open Source
Social Links

GGML Features

  • Written in C
  • Supports 16-bit floats and integer quantization (e.g., 4-bit, 5-bit, 8-bit)
  • Automatic differentiation
  • Built-in optimization algorithms (e.g., ADAM, L-BFGS)
  • Optimized for Apple Silicon and x86 architectures
  • Web support via WebAssembly and WASM SIMD
  • No third-party dependencies
  • Zero memory allocations during runtime
  • Guided language output support
  • Open source under the MIT license

Use Cases of GGML

  • whisper.cpp: High-performance inference of OpenAI's Whisper automatic speech recognition model.
  • llama.cpp: Inference of Meta's LLaMA large language model.

Contributing: You can support the project by contributing to the codebase or becoming a sponsor. The development process is open, and innovative ideas are encouraged.

Company: GGML.ai, founded by Georgi Gerganov, supports GGML's development, with sponsorship from Nat Friedman and Daniel Gross. They are seeking full-time developers to advance on-device inference.

GGML Reviews

Please login to write a review.
{{ reviewsTotal }}{{ options.labels.singularReviewCountLabel }}
{{ reviewsTotal }}{{ options.labels.pluralReviewCountLabel }}
{{ options.labels.newReviewButton }}
{{ userData.canReview.message }}

Similar Tools

GPT95
Manage code snippets, visualize your codebase, refactor complex code, and optimize team performance ...
GitPoet
GitPoet simplifies commit message creation using AI, enhancing code collaboration and efficiency. Ta...
IMGCreator.ai
IMGCreator.ai is an AI tool that swiftly generates images based on text inputs, offering various sty...

Select Filters to Apply

Features
Features
Pricing
Pricing

Sign Up To Favorite


Join our community of [edit 175000] proactive proffesionals adopting AI tools in there work

You’ll also recieve our free weekly newsletter that includes new tools, helpful tutorials and exclusive deals.
https://www.ailisting.ai/aitool/ggml/
Features
Features
Pricing
Pricing