---
type: community
cohesion: 0.09
members: 38
---

# Tokenizer Model Provider

**Cohesion:** 0.09 - loosely connected
**Members:** 38 nodes

## Members
- [[.Close()_2]] - code - ai/gemini/model.go
- [[.CountTokens()]] - code - ai/gemini/model.go
- [[.Generate()_2]] - code - ai/gemini/model.go
- [[.GenerateStream()_2]] - code - ai/gemini/model.go
- [[.ID()]] - code - ai/gemini/model.go
- [[.Name()_3]] - code - ai/gemini/model.go
- [[.Tokenize()]] - code - ai/gemini/model.go
- [[.Tokenizer()_2]] - code - ai/gemini/model.go
- [[.getClient()]] - code - ai/gemini/model.go
- [[.getLocal()]] - code - ai/gemini/model.go
- [[AIRequest_1]] - code - ai/gemini/model.go
- [[AIResponse_1]] - code - ai/gemini/model.go
- [[Client]] - code - ai/gemini/model.go
- [[Context_2]] - code - ai/gemini/model.go
- [[DebugSink]] - code - ai/gemini/model.go
- [[FunctionCall]] - code - ai/gemini/model.go
- [[GenerateToolCallID()]] - code - ai/tool_call.go
- [[LocalTokenizer]] - code - ai/gemini/model.go
- [[Model_2]] - code - ai/gemini/model.go
- [[Mutex]] - code - ai/gemini/model.go
- [[Part]] - code - ai/gemini/model.go
- [[Provider]] - code - ai/gemini/model.go
- [[RawMessage]] - code - ai/gemini/model.go
- [[T_2]] - code - ai/gemini/model_test.go
- [[TestBuildTextToken()]] - code - ai/gemini/model_test.go
- [[TestBuildThoughtToken()]] - code - ai/gemini/model_test.go
- [[TestMapFunctionCall()]] - code - ai/gemini/model_test.go
- [[TestMapFunctionCallEmptyName()]] - code - ai/gemini/model_test.go
- [[TestMarshalArgsNilDefaultsToObject()]] - code - ai/gemini/model_test.go
- [[TestModelTokenizer()]] - code - ai/gemini/model_test.go
- [[Token_1]] - code - ai/gemini/model.go
- [[Tokenizer_1]] - code - ai/gemini/model.go
- [[Tokenizer_2]] - code - ai/gemini/model.go
- [[ToolCall_1]] - code - ai/gemini/model.go
- [[buildTextToken()]] - code - ai/gemini/model.go
- [[mapFunctionCall()]] - code - ai/gemini/model.go
- [[marshalArgs()]] - code - ai/gemini/model.go
- [[model_test.go]] - code - ai/gemini/model_test.go

## Live Query (requires Dataview plugin)

```dataview
TABLE source_file, type FROM #community/Tokenizer_Model_Provider
SORT file.name ASC
```

## Connections to other communities
- 2 edges to [[_COMMUNITY_Token response testgo]]
- 1 edge to [[_COMMUNITY_Gemini Provider Model]]
- 1 edge to [[_COMMUNITY_Name GenerateStream Tokenizer]]
- 1 edge to [[_COMMUNITY_Content Builder Mistral]]
- 1 edge to [[_COMMUNITY_Tokenizer chatMessageRequest mistralToolCallState]]

## Top bridge nodes
- [[GenerateToolCallID()]] - degree 4, connects to 2 communities
- [[Model_2]] - degree 17, connects to 1 community
- [[.GenerateStream()_2]] - degree 8, connects to 1 community
- [[Tokenizer_2]] - degree 8, connects to 1 community