I think it’s as you say. Lemmy’s growth is going to happen in waves, until it has reached a critical mass that sustains its own “weight”, in terms of growth.
You have to remember that this is no commercial platform, with little advertisement, which is made by its own users. Growth is bound to be slow, at first.