Provided is a memory device and a method of forming the same. The method includes: providing a substrate having multiple active regions; forming a first layer stack on the substrate; patterning the first layer stack to form multiple recesses in the first layer stack; forming a liner layer on the first layer stack to cover the recesses; performing an etching process to remove a portion of the liner layer and the first layer stack below the recesses, so as to extend the recesses downward to form multiple openings, wherein the openings respectively expose the active regions; respectively forming multiple conductive structures in the openings; forming a second layer stack on the conductive structures; and patterning the second layer stack and the conductive structures to form multiple bit-line structures and bit-line contacts, respectively.