Preheat the oven to 375° F.
In a medium bowl, mix together the graham crackers, sugar, and butter. Press the mixture into a 9-inch pie plate in an even layer, pressing the crumbs up the sides of the pie plate. Bake for 7-8 minutes, until golden brown, then let cool completely.
While the crust is cooling, whisk together the sugar, flour, and salt in a medium saucepan. Add the milk and mix until well combined. Turn the heat to medium and cook until slightly thickened and bubbling.
Pour about 1/2 cup of the milk mixture into the egg yolks, and mix quickly to combine. Pour the egg yolks back into the saucepan and mix, stirring constantly, until the pudding is thickened. Remove from heat and stir in the vanilla. Let the pudding cool for 10-15 minutes, until just slightly warm.
Add the cream cheese to a medium bowl and beat until smooth. Add the pudding to the cream cheese and mix until well combined.
Pour 1/3 of the pudding mixture into the pie crust, spreading evenly. Top with the sliced bananas, then pour the remaining pudding mixture over the top. Chill in the refrigerator for at least 2 hours, until thoroughly chilled.
To serve, top with whipped cream or cool whip, and garnish with sliced bananas.