You can add multiple videos in a source via the Video Playlist plugin.
Click on Add source > General Widgets > Video Playlist…
The Video Playlist source properties window will appear. Click on Add and select the video files that you want to add into your playlist.
When you are done, click Ok to save. If you like to know more about the Video Playlist source, click here.