In this paper, we tackle a virtual network embedding problem in network virtualization. For this problem, an algorithm (VNE-TD) based on temporal difference learning has been proposed. VNE-TD, however, does not consider the node and link resource constraints in selecting the candidate solutions. Therefore, when attempting to construct a virtual network, the embedding of a virtual network may fail due to insufficient resources. In this paper, we modify VNE-TD to select only those candidate solutions that satisfy the node and link resource constraints. We add a function to check the satisfiability of the node and link resource constraints to VNE-TD. The simulation results show that our modified methods reduce the blocking ratio of virtual network requests by up to 80% compared to VNE-TD.