Several weeks pass. Aloïse de Gondelaurier is a widow, and her daughter, Fleur-de-Lys, is training to work as a companion to the Flemish princess. Aloïse sits beside Phoebus, captain of the royal guards; he ignores a crowd of watching women. Phoebus is engaged to Fleur-de-Lys but has little interest in her. He chats with her to satisfy Aloïse, though Fleur-de-Lys sees his boredom. When someone calls out that Esmeralda is dancing in the square outside, the ladies rush to the balcony. Phoebus hangs back, preferring the company of his fellow soldiers to that of ladies, but recognizes Esmeralda as the woman he saved. The women spot a figure in the towers of Notre-Dame; it is Frollo, who is staring at Esmeralda in a predatory fashion. Fleur-de-Lys remarks that Frollo is known for his hatred of Romany people. She encourages Phoebus to invite Esmeralda into the house. Esmeralda, recognizing the handsome Phoebus, accepts the invitation. Her beauty dazzles the women as she speaks with Phoebus about her foiled kidnapping.

His interest in Esmeralda rankles the women. Jealous, they hurl insults at Esmeralda, who meekly accepts their words. Phoebus, however, praises her. Djali rushes in and disrupts the scene, leading to suggestions that Esmeralda is a witch who has taught magic to her goat.