Who's going to complain about something like that really. Don't worry I don't think they'll take action against you for picking up your pen off the floor, it happens to everyone, your manager knows your pen rolls off the table and that so I doubt he'll think you did it on purpose to look provocative