The Scots Peerage citation has these children:
By his first wife Eupheme Drummond
1. Malcom 3rd Lord Fleming
2. Malcom, Prior of Withorn
3. James
By his 3rd wife Agnes
4. Margaret
Unknown mothers:
5. Unknown da.
6. Unknown da.
On Elizabeth Fleming, the history of parliament entry on her son Thomas describes her as "Elizabeth, da. of one Fleming of Dartmouth".
I'm going to disconnect her w/ a note.