Ooooh don't even go there today . The answer is kubernetes which is not an answer but another layer of problems.
Processes are all the virtualization we really need. Containers are an excuse to let people get away with steaming shit for software architecture by pretending there is adequate isolation between the lumps of poo floating in the lake of diarrhea.
I was about to recommend the same thing. You should look at Kubernetes
Then run away, fast.
Ooooh don't even go there today . The answer is kubernetes which is not an answer but another layer of problems.
Processes are all the virtualization we really need. Containers are an excuse to let people get away with steaming shit for software architecture by pretending there is adequate isolation between the lumps of poo floating in the lake of diarrhea.
Deploying shitloads of Neural Networks for production use ... Each one is hooked up to an endpoint of a message queuing system, and of course we have load balancing by splitting the input into segments and fanning them out and later reassembling them.
Take this and about 30 - 40k users a day ....
puuuhhhh ...
But it's a small installation, just 3 TB of main memory and ~ 200 cores plus 4 Teslas ...
Oooh fun. Similar architectural fun here albeit there has been a visit from the Microservices Gnome (ref underpants gnomes)
MICROSERVICES
?
PROFIT
Actually no, what we have now is an http based damage multiplier and database DoS attack architecture. What would suffice with a couple of joins now does 5 distinct queries and does the join in the service consumer thus multiplying IOPS and latency at the same time!!!
Edit: replaced my last comment. Software "engineers" (in quotes intentionally) are fashion victims, nothing more.
Just add more abstraction, microservices and the problem is solved! Nope!
Just add more abstraction, containers and the problem is solved! Nope!
Just add more abstraction, cluster orchestration and the problem is solved! Nope!
Just add .... TBD.
Edit 2: sorry celebrating my minor IT victory today with alcohol so getting a bit ranty. Also Cerebus owes me at least 3 hours of my life back as well playing with godbolt.org and comparing GCC versions
(really, I appreciate it as I have learned a lot)
Edit 3: apologies for the TEA distraction btw. I am returning to sanity now and have added two things to watch list of interest