Go to Online Course > Online Course click on the Manage Course button of the course.
Then click on the Publish Course button present at the top right corner.
By default course will be unpublish so you will see Publish Course button, once course is published button will be change to Unpublish Course.
