The history of the Coffee House at College Street can be traced to Albert Hall, which was founded in April 1876. This Albert Hall was the primary residence of Ramkamal Sen, Treasurer of the Bank of Bengal and Secretary of the Asiatic Society, Calcutta, in the early 19th century.
Later, the Coffee Board decided to start a coffee joint from the Albert Hall in 1942. Notable citizens were frequent visitors to the place. In 1947, the Central Government changed the name of the place to "Coffee House". The place became a meeting place for the poets, artistes, literati and people from the world of art and culture. In 1958, the management decided to shut down the Coffee House, but it was re-opened the same year, after professors of Presidency College and Calcutta University rushed off a special petition to the government, to save the heritage place. In 2006, a huge financial crunch kept the co-operative society from undertaking renovation of the coffee house. Though a few companies such as Asian Paints approached the society with offers to renovate the restaurant, the offers were refused due to clash of norms and conditions.