HOT models

 

 

Settings provided by: GERGE

 

Settings provided by: ShotMisser64

 

Models

  • GP
  • FP8
  • Qwen2.5-72B-Instruct-Turbo
  • Context: 32K

 

 

 

 

 

 
  • RP
  • llama-3-lumimaid-8b-v0.1
  • Context: 8K

 

 

 Settings provided by: ShadingCrawler

 

Settings provided by: GERGE

 

Settings provided by: GERGE

 
  • FP8 Dynamic
  • RP
  • Llama-3-TenyxChat-DaybreakStorywriter-70B-fp8-dynamic
  • Context: 16K
  • Settings:
  • RP Instruct: https://files.catbox.moe/i3z4wv.json
  • RP Context: https://files.catbox.moe/1k8p5b.json

Settings provided by: ShotMisser64

 
  • RP
  • MN-12B-Celeste-V1.9
  • Context: 32K
  • Roleplay settings:
  • Use 0.3 temp and 1.05 for rep pen (GREGE)
 
  • GP, RP
  • FP8 Dynamic
  • 01-ai-Yi-1.5-34B-Chat-16K-tokfix-fp8-dynamic
  • Context: 16K

 

 
  • GP, RP
  • FP16
  • Sao10K-3.1-70B-Hanami-x1
  • Context: 32K

 

 
  • Mixtral-8x7B-Instruct-v0.1
  • General purpose
  • Context: 32K
 
  •  General purpose, RP, Storywriting.A generalist / roleplaying model merge based on Llama 3. 
  • L3-8B-Lunaris-v1
  • Context: 8K
  • Settings:
  • RP Instruct / RP Context: Llama-3-Instruct

 

 
  • GP, RP
  • BF16
  • EVA-UNIT-01-EVA-Qwen2.5-14B-v0.1
  • Context: 32K

 

 
  • RP
  • BF16
  • TheDrummer-Rocinante-12B-v1.1
  • Context: 32K

 

 
  •  General purpose, RP, Storywriting.This is a merge of pre-trained language models.
  • MN-12B-Starcannon-v2
  • Context: 12K
  • Settings:
  • RP Instruct: https://pastebin.com/m9p32Mcv
  • RP Context: ST Default ChatML

Settings provided by: 1eemon

 
  • FP8 Dynamic
  • RP
  • llama-3-lumimaid-8b-v0.1
  • Context: 8K

 

 
  • BF16
  • GP
  • Mixtral-8x7B-Instruct-v0.1
  • Context: 32K

 

 
  • BF16
  • GP
  • Qwen2-72B-Instruct
  • Context: 32K

 

 
  • BF16
  • GP
  • NousResearch-Hermes-3-Llama-3.1-8B
  • Context: 128K

 

 
  • BF16
  • GP
  • Pixtral-12B-2409
  • Context: 8K

 

 
  • BF16
  • GP
  • Llama-3.2-11B-Vision-Instruct-Turbo
  • Context: 128K

 

 
  • FP8
  • GP
  • Meta-Llama-3.1-70B-Instruct-FP8-dynamic
  • Context: 16K

 

 

COMING SOON

GOING SOON

Guides

Guide to quant FP8

Simple Guide to Convert an FP16 Model to FP8 Overview This simple guide to quant [...]

Models

L3-70B-Euryale-v2.1

Meet L3 70B Euryale v2.1: Your New Creative Companion What is L3 70B Euryale v2.1 [...]

Guides

Using Infermatic.ai API with SillyTavern

SillyTavern is one of the most popular interfaces to interact with LLMs. We have been [...]