The federal government is offering up the Kingston Penitentiary for potential development to become affordable housing units.