mick/Frankenstein
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Checked nothing broke

Browse Source
This commit is contained in:
Mick Walter 2025-06-19 18:07:23 +02:00
parent 584776b39a
commit 00d2b0e777
1 changed files with 4 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

6
embedding.ipynb
View File

@ -23,7 +23,7 @@
"This notebook attempts to open up 2 LMM models, and swap out the input and output embeddings and tokenizer.\n", "This notebook attempts to open up 2 LMM models, and swap out the input and output embeddings and tokenizer.\n",
"It then runs the model to see if the output still makes sense (hint: actually I dont think you need a hint)\n", "It then runs the model to see if the output still makes sense (hint: actually I dont think you need a hint)\n",
"\n", "\n",
"Be mindful of the difference between weights[:]= and weights= (I probably messed that up pretty often)" "Be mindful of the difference between weights[:]= and weights= (I may have messed that up at times)"
] ]
}, },
{ {
@ -86,11 +86,13 @@
}, },
{ {
"cell_type": "code", "cell_type": "code",
"execution_count": 110, "execution_count": null,
"id": "153e9ff5", "id": "153e9ff5",
"metadata": {}, "metadata": {},
"outputs": [], "outputs": [],
"source": [ "source": [
"# Download 2 models.\n",
"\n",
"modelA, tokenizerA = grab_model(\"gpt2\")\n", "modelA, tokenizerA = grab_model(\"gpt2\")\n",
"modelB, tokenizerB = grab_model(\"EleutherAI/gpt-neo-125M\")\n", "modelB, tokenizerB = grab_model(\"EleutherAI/gpt-neo-125M\")\n",
"\n", "\n",