A project to bring affordable apartments to Fondren has been in the works since 2013, but the construction began last month and is causing concern for some residents.