Likely, you'll need to add a database index to your members table. CT Admin relates customer data through the email address so doing the index should speed things up significantly.

 

Just execute the below SQL and you'll be good to go:

ALTER TABLE `exp_members` ADD INDEX ( `email` )