10 Commits

Author	SHA1	Message	Date
Michael Yang	d26c18e25c	fix token type	2025-04-25 16:59:01 -07:00
Michael Yang	3b96a93672	fs: move ml.Config to fs package	2025-04-03 13:12:24 -07:00
Jeffrey Morgan	b51e0f397c	model: fix issues with spm tokenizer for Gemma 3 (#10081)	2025-04-02 13:22:56 -07:00
Jesse Gross	0fbfcf3c9c	model: Pass input tensor instead of raw data to models ... Rather than directly giving the input data to models, we can pass a tensor instead. In the short term, this saves some duplicated code. Longer term, we will want to overlap setting up the next batch with processing of the current one. In this case, we will only have the shape of tensor but it will not be loaded with data at the time of graph generation. By passing only a tensor to models now, we set up this possibility and prevent them from relying on data that they won't have in the future. Although the same could be done for Positions and Outputs, in some cases we either need the raw input data or don't use them at all. Therefore, for now we leave them as they are and allow models to convert them to tensors as needed.	2025-03-20 13:28:13 -07:00
Jesse Gross	0c220935bd	input: Rename Options to Batch ... Options is no longer very descriptive of this struct.	2025-03-20 13:28:13 -07:00
Jesse Gross	b078dd157c	gemma2: Remove second call to Rows ... Looks like a merge conflict that broke the model.	2025-03-19 17:28:49 -07:00
Jeffrey Morgan	da0e345200	ml: use input context for extracting outputs (#9875)	2025-03-18 18:08:19 -07:00
Jesse Gross	0e886595bf	Fix tests and drift from main	2025-03-11 14:49:18 -07:00
Jesse Gross	4346c2409d	fix drift from main	2025-03-11 14:49:18 -07:00
Patrick Devine	5f74d1fd47	gemma2 impl	2025-03-11 14:35:08 -07:00