So, is scale the only difference between quantum and classical physics?

At a very basic level, we could say that quantum physics is used to describe the microworld, while the macroworld is governed by classical physics. However, many macroscopic objects can be described with quantum physics – you just have to know where to look.