Allowing Gitlab CI Runners to use RVM is really easy: That’s all. Just keep in mind, that each time you want a new Ruby version, you will have to login as gitlab_ci_runner and install it from console.

Read more at the source