JavaFX mouse click event for Labels

I am trying to build a simple planner app using JavaFX. My current goal is to be able to:

1. click on a panel of the calendar (already implemented)
2. type in a task, hit enter and have it show up as a Label (already implemented)
3. click on the currently placed labels and remove them from the calendar. (issue)

Step 3 is where I am having most trouble. I am confident that I am setting up my mouse event for the label correctly but when I click on one of the labels it runs the mouse event for the panel. I need a way to override the pane's mouse event so I can use the labels mouse event, but I'm not too sure how to go about that. Any feedback would be great!

this.setOnMouseClicked(e -> 
    {
    	TextField field = new TextField();
    	this.getChildren().add(field);
    	
    	//sets field as a label
    	 field.setOnKeyPressed(new EventHandler<KeyEvent>() {
    	        @Override
    	        public void handle(KeyEvent key) {
    	            KeyCode k = key.getCode();
    	            if ((k.equals(KeyCode.ENTER))) {
    	            	Label lab = new Label(field.getText());
    	            	getChildren().add(lab);
    	            	getChildren().remove(field);
    	            }
    	        }
    	    });
    	 
    	 //removes textfield and label
    	 field.setOnKeyPressed(new EventHandler<KeyEvent>() {
 	        @Override
 	        public void handle(KeyEvent ke) {
 	            KeyCode kc = ke.getCode();
 	            if ((kc.equals(KeyCode.ESCAPE))) {
 	            	getChildren().remove(field);
 	            }
 	        }
 	    });  	 
    }); 
    if(lab != null)
    {
        lab.setOnMouseEntered(new EventHandler<MouseEvent>() {
            @Override
            public void handle(MouseEvent e) {
            	setStyle("-fx-background-color: #00FF00;");
            }
          });
    }