A handle device includes: a handle base attached to an inside of a door panel of a vehicle; an operation handle including a first engagement portion engageable with one end side of the handle base and a second engagement portion engageable with the other end side of the handle base; a cylinder lock attached to the other end side of the handle base; and a cylinder cover attached to the cylinder lock from an outside of the door panel. The cylinder cover attached to the cylinder lock is covered with the operation handle. The operation handle is slid to the one end side of the handle base and the first engagement portion is engaged with the handle base, and movement of the operation handle to the other end side is restricted by the cylinder cover attached to the cylinder lock.