111·
1 day agoReally, the guy currently in charge of trying to dismantle the US government you don’t particularly care about? Assuming you aren’t from the US, so perhaps US internal politics don’t bother you, but he is also pushing for the far right in Germany, which means he wont stop at destroying America for his own profit. The richest man in the world is currently dismantling one of the largest countries in the world should probably concern everybody in the world, at least a little.
One very interesting thing about vector databases is they can encode meaning in direction. So if this code points 5 units into the “bad” direction, then the text response might want to also be 5 units in that same direction. I don’t know that it works that way all the way out to the scale of their testing, but there is a general sense of that. 3Blue1Brown has a great series on Neural Networks.
This particular topic is covered in https://www.3blue1brown.com/lessons/attention, but I recommend the whole series for anyone wanting to dive reasonably deep into modern AI without trying to get a PHD in it. https://www.3blue1brown.com/topics/neural-networks