Chat with Franok
An experimental English–Turkish model. Your messages stay on this device.
Model architecture
Inside Franok
A token goes through twelve layers. In each layer, it reads the words before it and uses one of eight feed-forward banks to update its representation.
Trace one token
Select a piece of text to see which bank reads it. Start and language markers count as positions. Each full group of eight sends one token to each bank.
Why eight banks?
Franok has 314 million learned parameters. About 50 million participate in one token’s prediction. The rotation sends one slot to each bank in every full group. This gives the model more stored weights than it has to read for a single token.
Where does the next word come from?
The tokenizer splits text into pieces. Attention weighs earlier pieces by their relevance. A gated feed-forward bank transforms the result. After twelve layers, the model assigns a probability to each of 8,192 possible next pieces.
How did it learn to answer?
- Read both languages. The decoder started with random weights. At each position it tried to predict the next piece of open English or Turkish text. Giving the observed piece a higher probability reduced its training loss.
- Practice conversation. Supervised tuning trained all layers on assistant replies. Earlier turns and system instructions were visible while the model learned which words should follow.
- Compare replies. Two low-rank adapters tuned dialogue and the choice between a supported answer and an alternative. These small updates can be inspected separately.
- Learn from its own attempts. Franok sampled six answers to a prompt. Reinforcement learning compared their rewards within the group and adjusted another adapter.
- Practice with a teacher. Larger open models, Qwen3-8B and Qwen3-14B, wrote practice conversations, and a grading pass removed the weak ones. Franok also practiced answering from a given passage and keeping counts and object locations straight, using generated dialogues whose answers are known exactly.
What does the app remember?
How well does Franok hold a conversation?
Franok met 3 of 32 conversation criteria across 16 English and Turkish chats, and 2 of 32 on a second set written before its latest training. It often loses the topic on a follow-up. The published transcripts show each prompt, the answer it gave and what counted as a successful response. Read the test conversations ↗
How does Franok find a quotation?
In passage mode, Franok reads the question before the source. A separate trained layer scores the start and end of possible quotes. When the best span clears its confidence threshold, the app highlights those exact bytes in the original text. Ordinary chat uses next-token generation.
Franok for Ubuntu
Install a standalone desktop workspace with dock integration, saved sessions, and on-device inference.
Verify the installer
Model files
The downloads share the same training lineage. The first download happens before local inference.