Basically, you should be able to do whatever you want and your actions have to be seen by the other party as acceptable or else you really aren’t compatible. This should be a no brainer. We end up with people, we are supposed to be with, if asking a neighbor is seen as having crossed a line then their behavior/ideas would not be compatible on the whole. My perception of the relationship is that she is interested and made an effort. I would be flattered. The neighbor saying she should be careful could be informative or revealing of his jealousy or whatever. The relationship obviously didn’t work.