HOT models

Settings provided by: GERGE

 

Settings provided by: ShotMisser64

 

 Settings provided by: ShadingCrawler

 

Models

Settings provided by: GERGE

 

Settings provided by: GERGE

 
  • FP8 Dynamic
  • RP
  • Llama-3-TenyxChat-DaybreakStorywriter-70B-fp8-dynamic
  • Context: 16K
  • Settings:
  • RP Instruct: https://files.catbox.moe/i3z4wv.json
  • RP Context: https://files.catbox.moe/1k8p5b.json

Settings provided by: ShotMisser64

 
  • RP
  • MN-12B-Celeste-V1.9
  • Context: 32K
  • Roleplay settings:
  • Use 0.3 temp and 1.05 for rep pen (GREGE)
 
  • RP
  • llama-3-lumimaid-8b-v0.1
  • Context: 8K

 

 
  • Mixtral-8x7B-Instruct-v0.1
  • General purpose
  • Context: 32K
 
  • deepseek-coder-33b-instructdeepseek-coder-33b-instruct
  • Coder, General purpose
  • Context: 8K

 

 

Settings provided by: GERGE

 
  •  General purpose, RP, Storywriting.A generalist / roleplaying model merge based on Llama 3. 
  • L3-8B-Lunaris-v1
  • Context: 8K
  • Settings:
  • RP Instruct / RP Context: Llama-3-Instruct

 

 
  •  General purpose, RP, Storywriting.This is a merge of pre-trained language models.
  • MN-12B-Starcannon-v2
  • Context: 12K
  • Settings:
  • RP Instruct: https://pastebin.com/m9p32Mcv
  • RP Context: ST Default ChatML

Settings provided by: 1eemon

 
  • General purpose, RP, Storywriting. handles natural language understanding and generation in multiple languages. It’s built with a sophisticated 72-billion-parameter Transformer architecture.
  • Qwen2-72B-Instruct
  • Context: 32K
 
  • FP8 Dynamic
  • RP
  • Meta-Llama-3.1-70B-Instruct-FP8-dynamic
  • Context: 16K

 

 
  • FP8 Dynamic
  • GP, RP
  • gemma-2-27b-it-FP8-Dynamic
  • Context: 4K

 

 
  • FP8 Dynamic
  • RP
  • llama-3-lumimaid-8b-v0.1
  • Context: 8K

 

 

COMING SOON

GOING SOON

Guides

Guide to quant FP8

Simple Guide to Convert an FP16 Model to FP8 Overview This simple guide to quant [...]

Models

L3-70B-Euryale-v2.1

Meet L3 70B Euryale v2.1: Your New Creative Companion What is L3 70B Euryale v2.1 [...]

Guides

Using Infermatic.ai API with SillyTavern

SillyTavern is one of the most popular interfaces to interact with LLMs. We have been [...]