Absolutely, security updates are much more important than feature updates. Upgrading to newer Android versions is mostly useful to have access to newer Android APIs (apps eventually will require newer versions, although that usually takes quite a while). Another benefit of newer Android versions might be added security features.