I am in the planning phase for programming a very visual maths teaching tool. I want to display equations with all sorts of animations (when a student cancels part of the equation out, those factors disappear in a smoke cloud, just whizz off into the distance, etc...) I will be using a 3D engine (irrlicht.net cp) and work in c#/mono, but that's all not really relevant.
What I came to ask is whether there is any way to get LaTeX to output the 2D coordinates at which it places digits, square roots, etc... I would like my game to be able to place 3D objects on a 2D plane in LaTeX's format... (the game could even be able to import text and equations straight from latex input, since that is pretty standard in the maths/science world

The format could be something like:
(0,10, "x");(10,10,"=");(20,10,"/",lengthofdivision);(20,15, "y");(20,5,3)
to tell my game to start by placing an x, then an equal sign 10 units to the right, then a division sign and a y above that division, a 3 below the division. Any text output in similar formats my program could easily use! Are there any existing programs that export lists of objects in coordinates, not just PDFs and JPGs?
you guys understand what I need? LaTeX telling me where in my world to place which object, and if the object has other parameters (like the length of a square root sign or division sign, those too) if there is no easy way to do this using latex I'll have to write my own functions for spacing, etc. Not too much of a problem, just won't ever be as pretty as something formatted by LaTeX

Thanks for reading and thinking about this
The German/Namibian in Cape Town