Android : Markers and Polylines through several maps

I have two maps in the same activity, one of the maps display Google map tiles from google play services lib and the other one display open street map tiles from a spatialLite database (the second one is for offline maps). I am able to add markers and polylines to both of my maps but when i switch from one map to another all my markers and polylines are gone because i'm adding them to the actual map.

Since i'm working with a lot information to display to the user and is painful to add all markers over and over again is there a way that i can add the markers and polylines into (for example) a middle pane on top of the maps that only have the markers and polylines so when i switch from one map to another i don't have to add everything again.