Dougherty County was created in 1853 by dividing Baker County. It is named for Judge Charles Dougherty of Athens, a popular advocate of states' rights. The county seat, Albany, is thought to have been named for the New York State capital.