Joel Potter (15 Dec 1740 - 29 Jul 1782) and Mary Crowell (07 Apr 1742 - 23 Mar 1782) seem to be a hard lineage to trace! What I have uncovered is they had three sons, Ephraim (25 Jan 1766 - 13 Oct 1843), Ezariah (1768 - 1822) and Samuel (1771 - 1822) as well as two daughters, Phila Crowell (29 Apr 1763 - 08 Jul 1833) and Rachel (29 Nov 1772 - 21 Feb 1858).
Joel's parents are Amos Potter (10 Aug 1725 - 13 Feb 1768) and Mary Meeker (21 Oct 1728 - 04 Feb 1790) while Mary Meeker's parents are John Meeker (1702 - 1731) and Joanna Ogden (02 Jun 1706 - 22 Apr 1761).
Amos Potter's parents were Daniel Potter (1692 - 17 Mar 1745) and Rachael Alden (1694 - 1727).
Daniel Potter's father was Samuel Potter (16 Sep 1669 - 02 May 1756) and mother unknown by myself.
Samuel Potter's father was also named Samuel Potter (07 Oct 1641 - 16 Nov 1696) and I believe his mother was Anna Russell (29 Jul 1650 - 09 May 1676).
Beyond this point I am uncertain...