We've been watching the fruit slowly ripen over weeks and within the last few days we have greatly enjoyed the bounty of our neighbor's efforts. The fruit is a tad tart at the moment but with only a few more days to partake, we aren't letting that stop us.
So to the answer the morality question posed: it is to each of us to decide our own answers within the shifting moral landscape of today's society. As for us, we will enjoy the passionfruit while we can.
Shhhh! Don't let the neighbors hear you picking them.