I will start by analyzing the concept of responsibility. Then I will discuss two problems: (1) how to think about and assess/assign/check responsibilities in a world where AIs are ubiquitous, and (2) how to endow such AIs with a sense of responsibility. I will sketch the problems and discuss which formal systems or other methods can be used to address these problems. I will also explain why I do not believe in sub-symbolic approaches when it comes to dealing with responsibility.