I have models with almost 200million and still fast.
Select * from if you don't use all fields is slower than
select field1, field2,...... from
Also datetime you can use floor() to remove timestamp......
Use autonumber to pk will reduce memory.
Have more things that you can do. Could you send a sample model?