interesting.
I always had the impression that you were somehow related to the Software industry.
By this, I mean, working as a develop of software for third party consumption. \
Of course, many people do work in software, but not as the company product, software is a tool.
anyway, yes, we are getting old, and now is time for the new generations to be our replacements.
I do not have the energy that I used to have anymore.
in the past two years, I turn my attention to machine learning, but not for the high level, but from the fundamentals.
I am really appalled at how much misinformation there is out there regarding to deep machine learning. But what else is new.
my interest in deep learning is for using a supplement tool, not the other way around.
I am interesting is using is as controllers for simulations.
so the change I made to the physics engine are to satisfy functionality required for interfacing with the deep learning library.
this is a very slow and tedious process, because I have to do everything be myself. but no one is waiting for me.
My experience with machine leaning so far, is that when it comes to controlling real things, it is not the slam dunk that people think it is.
Reinforcement learning based on deep neutral nets, excels at stuff like large language model, image generation, classification, and stuff like that.
But is is much harder when trying to use for physic. Simulation.
Reason is that need mural net are just big interpolator and extrapolators from data points.
So when the data point are factuals, meaning you get it from an object e source, them the prediction are more reliable.
When the data comes for a simulation, the data point can be very unreliable, so the generate result are just as good as the input data.
so the whole idea is to train the net to generate interpolations that are rewarded high by some objective function and discard the one that are reward low.
people have been doing that unsuccessfully for decades.
-Nearest neighbor interpolation.
-Principal component Analysis.
-Gaussian processes
-Linear regressions
-Lineal control theory
are just some of the few methods. I experiments with few of them, but I have to admit they do not come close to what a deep neural net can archive.
the only problem with it, is that when it comes to physical problem, it is not true that given two different physics state of a configuration, and interpolate state is also another valid state.
so, training robots, is still and unsolved hard problem, albeit it is way simpler to talked using deep neural net that using these other methods.
anyway, that's what I am doing now.
We are actually using AI to some degree, not for something cool like teaching a robot to walk but we have an AI that knows how a perfect pizza should look like and sort out the bad ones from a conveyor belt
exactly
