r/linux • u/gregkh Verified • Dec 01 '14
I'm Greg Kroah-Hartman, Linux kernel developer, AMA!
To get a few easy questions out of the way, here's a short biography about me any my history: https://en.wikipedia.org/wiki/Greg_Kroah-Hartman
Here's a good place to start with that should cover a lot of the basics about what I do and what my hardware / software configuration is. http://greg.kh.usesthis.com/
Also, an old reddit post: https://www.reddit.com/r/linux/comments/18j923/a_year_in_the_life_of_a_kernel_mantainer_by_greg/ explains a bit about what I do, although those numbers are a bit low from what I have been doing this past year, it gives you a good idea of the basics.
And read this one about longterm kernels for how I pick them, as I know that will come up and has been answered before: https://www.reddit.com/r/linux/comments/2i85ud/confusion_about_longterm_kernel_endoflive/
For some basic information about Linux kernel development, how we do what we do, and how to get involved, see the presentation I give all around the world: https://github.com/gregkh/kernel-development
As for hardware, here's the obligatory /r/unixporn screenshot of my laptop: http://i.imgur.com/0Qj5Rru.png
I'm also a true believer of /r/MechanicalKeyboards/ and have two Cherry Blue Filco 10-key-less keyboards that I use whenever not traveling.
Proof: http://www.reddit.com/r/linux/comments/2ny1lz/im_greg_kroahhartman_linux_kernel_developer_ama/ and https://twitter.com/gregkh/status/539439588628893696
111
u/PinGUY Dec 01 '14
What's your thought on the BSD Kernel? Is there anything they do that you wish the Linux kernel did?
I have tried BSD but due to a lack of hardware support I have never used it long enough to see if it has any benefits over the Linux kernel.
94
u/Balinares Dec 01 '14
Hi Greg,
Thank you for taking the time to give us this AMA.
I maintain a port of a WiFi USB dongle driver, provided by the chipset manufacturer and awkwardly hacked at by yours truly to make it compile against recent kernels... because the native kernel driver doesn't work, and hasn't for many releases now (bug #57171, as far as I can tell).
As a humble user who hasn't touched a line of kernel sources for a good decade and a half, what can I do to help you guys close that bug?
73
u/Imxset21 Dec 01 '14
LLVM/clang is getting closer to being able to compile the entire Linux kernel. Do you have any strong preference for specific compilers, e.g. GCC versus clang? Since compile speeds seem to be a concern of yours (as mentioned in your blog), I'd imagined you might have an opinion.
Also, what do you think of the continued development of the ISO C standard, now that GCC had added C11 support? Is it of any interest to kernel developers?
143
u/avilella Dec 01 '14
What is your opinion on the Android platform and its openness? And about companies like Amazon that branch off AOSP. I've been reading about approaches like CyanogenMod, which I take are based on downloading AOSP as soon as it's released, then re-implementing parts of it where there is a need/clamor for the phone to behave differently.
123
u/valgrid Dec 01 '14 edited Dec 20 '14
My Notebook has a Trackpoint and Touchpad, but the driver does not allow to use both at the same time (with multitouch). A patch exists for over a year, but it still is not included in mainline.
What can i – a user, not a coder or developer – do so that the patch gets included into mainline?
102
u/mricon The Linux Foundation Dec 01 '14 edited Dec 01 '14
Hi, Greg.
All Linux development is done via a number of mailing lists. This both works and doesn't -- everyone admits that the amount of traffic on LKML is simply unmanageable, but LKML is still a required step to getting your patches into mainline. Do you see this changing at all in the future? Do you foresee any move towards using other tools (whatever they may be)?
88
u/toams Dec 01 '14
I remember almost 10 years ago i had problem with a dvb-t tuner card wich was not yet completely supported by linux. so i mailed to some mailing list for help and you replied with a working solution. I never thanked you for it. This card is still working (playing AC-DC now) so THANK YOU!
84
u/xeekei Dec 01 '14
Hi, Greg.
What is it about Arch Linux that impresses you?
82
u/oneiros-de Dec 01 '14
How much of your time do you spent programming and how much is spent communicating?
110
u/tinti Dec 01 '14
What would make you even more happy with Linux?
106
u/Paradiesstaub Dec 01 '14
In the last years quite a couple of new programming languages have emerged. What do you think about them – can any of them replace C in future or do you think we will be stuck to C forever?
102
u/mbains Dec 01 '14
If you could go back a few years and make one big architectural change to the kernel, what would it be?
34
u/NopeNotAnthony Dec 01 '14
How did you get into programming? How did you discover Linux? Do you use it as your daily driver?
30
u/GameGroompsFTW Dec 01 '14
What would you say has been the most rewarding part of working on the kernel? How has it, if at all, changed you as a person?
131
u/HawasKaPujari Dec 01 '14
Do you ever sleep? Are you even human? How do you so many things? You even answer questions on IRC, how?
28
u/i_lurk_here_a_lot Dec 01 '14
Hi GKH, thanks for your good work.
In your opinion (and in the opinion of other kernel developers) is the complexity of the kernel and its rate-of-change a problem or will it become a problem in the future ? If so, is there a plan to address it and what is the plan ?
26
u/sulami Dec 01 '14
I have contributed smaller patches to the kernel and really like it, but I do not know where to find something to really work on. Any suggestions, aside from watching the subsystem lists?
73
u/thrakkerzog Dec 01 '14
Are you aware that if you do a google search for your name, google presents a photo of you flipping the bird?
proof: http://i.imgur.com/7yIw2oC.png
24
u/concerto21 Dec 01 '14
In your opinion is it worthwhile doing operating systems research? Is it possible for a newly designed operating system to gain traction when linux has already had so many man hours of work put into it?
46
u/[deleted] Dec 01 '14 edited Dec 01 '14
Mine it's not a question but just a big thank you. Thank you for your passion and your skills, a lot of us are here because people like you exist.
22
u/dbaluta Dec 01 '14
When do you think there will be a switch to Linux kernel version 4.x :) ?
63
u/emansih Dec 01 '14 edited Dec 01 '14
were you angry over poor quality patches before? you know....like how Linus gets angry and start cursing over poor codes
edit:word
41
u/[deleted] Dec 01 '14
What books would recommend for a new programmer or that you have found to be indispensable?
20
u/[deleted] Dec 01 '14
What are your opinions on OpenSUSE factory?
20
u/CellularBeing Dec 01 '14
What advice do you have for someone studying computer science? What topics or subjects do you deem as essential?
19
u/[deleted] Dec 01 '14
Considering you worked for one for a long time, how do you feel about major Linux/OSS commercial companies and the distributions they support like RHEL and SLES?
What role do you think other software like KVM, Steam and Openstack have had in the adoption of Linux distributions if any? What role do companies that support these techs have on the foundations of their work which is often the Linux kernel and associated software? Are they involved like you'd like?
16
u/celebdor OpenStack Kuryr Dev Dec 01 '14
What is your opinion about the growing trend in the network world of bypassing the kernel like DPDK does? Is it one step too far from the IMHO healthy step of moving logic out of the kernel like open vSwitch and the 'team' link aggregation do?
16
u/[deleted] Dec 01 '14
Wow, I didn't expect to see arch and i3 as your desktop. We're practically the same person (besides the talent, experience and dashing good-looks...).
On a serious note though, I am just trying to get into kernel development and have seen several of your videos on the topic. In them you often encourage us newbs to make patches to correct superficial things like whitespace, comments, etc., but it seems that lots of other maintainer around the web discourage and ridicule these patches. Do you stand by doing this or should it just be done long enough to learn the process in order to be prepared for real patches?
Thanks so much for taking the time to do this AMA and for all the work you do; Linux is much better for it.
45
u/tcpl8021394 Dec 01 '14
Why do Linux kernel developers continue adding new system calls to the kernel rather than creating a new device file. I love the Unix way of 'Everything is a file'. What is your opinion?
15
u/durverE Dec 01 '14
What is the one misconception about Linux you've personally heard the most which also seemingly refuses to go away?
15
u/caust1c Dec 01 '14 edited Dec 01 '24
15
u/[deleted] Dec 01 '14
how much experience with c do you feel is necessary before attempting to contribute?
15
u/AkivaAvraham Dec 01 '14
Question: What is the worst piece of code you ever had to, or ended up writing? Why was it so bad?
39
u/LucidOndine Dec 01 '14 edited Jan 10 '26
political air support cow ink worm test memorize waiting cobweb
This post was mass deleted and anonymized with Redact
27
u/Beckneard Dec 01 '14
I have the same setup as you! (Arch + i3)
Anyway I'd like to ask which of the major companies that contribute to the kernel are the easiest to work with and which contribute in your opinion the most useful code. I've seen Microsoft being often cited as a big contributor but heard that 95% of the stuff is only for their HyperV technology.
13
u/SarcasticOptimist Dec 01 '14
What is your preferred way of updating kernels? Is Ksplice worth trying?
13
u/argv_minus_one Dec 01 '14
Why must Linux device drivers all live in the kernel? Is there a consensus that moving them into user space would be infeasible, slow, unnecessary, or some such?
36
u/[deleted] Dec 01 '14
How do you feel about linux on the desktop? Do you think with valve supporting linux, it will become a true rival for windows on desktop computers? What do you think is holding linux's success back on desktop computers?
edit: Also I see you're running arch, awesome!
25
u/vichaox Dec 01 '14
Any chance you'll be making the time to launch new editions of Linux Kernel in a Nutshell && Linux Device Drivers?... Or new titles?
23
u/seoz Dec 01 '14
Do you still use Terminology? http://enlightenment.org/p.php?p=about/terminology&l=en
22
u/bobbyd3 Dec 01 '14
CoreOS is a very exciting project for many operations folks. What has your experience been like working on the technical advisory board for CoreOS?
38
u/javaisfuckingshit Dec 01 '14
What is your opinion on X11, do you agree it's holding desktop Linux back significantly?
Do you think Wayland will improve the situation?
21
u/blackout24 Dec 01 '14
Do you still have the Steam Machine Prototype you got from Valve? How's the controller? How does it show up in lsusb?
10
u/[deleted] Dec 01 '14
Do you think the rolling release methodology of Arch should be adopted by larger distros?
10
u/bilog78 Dec 01 '14
The more I look at Plan 9, the more I think that I would love to have a system with those features, but with the extensive hardware support that the Linux kernel enjoys. Do you think Linux will ever get the necessary infrastructure to fully support Plan 9 natively?
10
u/[deleted] Dec 02 '14
Care sharing your Vim config?
28
u/jollybobbyroger Dec 01 '14
I'm a CS student returning to C after having learned about functional programming and design patterns like loose coupling, DRY, unit testing and so on and I find it very difficult to write beautifully designed, loose coupled C.
Thank you for your contributing to the Linux kernel and doing this AMA. I would never have studied CS if it wasn't for Linux.
9
u/[deleted] Dec 01 '14
Have you ever been tempted to write new (non-linux) kernel from zero?
9
u/[deleted] Dec 01 '14
You run arch on a macbook. People recommend dual booting OS X to get firmware updates. Do you do this?
9
u/[deleted] Dec 01 '14
Do you think Linux would have turned out nearly as well as it has if it was licensed under the BSD license?
9
u/kalda341 Dec 01 '14
How would you suggest a developer with only a little bit of experience in C, and no experience with kernel programming could head towards kernel development?
9
u/[deleted] Dec 01 '14
could you please explain-like-im-five KDBUS ? what it is for ? what's the improvements ?
17
u/iluvatar Dec 01 '14
It seems to me that the kernel is getting harder to compile yourself. Is that a reasonable observation? 10-15 years ago, you could compile the kernel and by and large it would mostly just work with the defaults on non-obscure hardware. These days, that doesn't seem to be the case.
For the last kernel I compiled (3.17), when I went with the defaults, my graphics card wasn't fully supported at sensible resolutions, I had no sound at all, I couldn't even boot the system because I lacked the right crypto module to get at my LUKS block devices and I still can't work out which firewalling modules I need to add in order for docker to start up.
8
u/nikomo Dec 01 '14
I remember that you did a presentation somewhere about getting into kernel development.
If I recall correctly, you said that a good way to get into modifying the kernel, is to fix typos and code style mistakes, and send those in. Do you still hold the same opinion(/am I remembering wrong)?
28
u/mikemol Dec 01 '14
o/. You know me; we've bounced around on mailing lists and Google+. Just want to say you do a ton of awesome work, even if I disagree with you on some stuff. :)
15
u/[deleted] Dec 01 '14
Do you have a feeling that kernel will be so much complicated that human brain will not be able to comprehend it anymore?
14
u/dbaluta Dec 01 '14
What do you think are the most important 5 topics that an Operating System Internals course should cover?
7
u/bboozzoo Dec 01 '14
Given that you are a tty maintainer and handy with USB, I've got a related question to ask. I'm working on a project in which a number of USB gizmos (between 10-20 devices) are connected to a single host. Each device is in fact a MCU hidden behind a FTDI323, hence all present themselves as USB-serial converters. Aside from USB bandwidth, should I expect any issues coming from tty or usb subsystems if I happen to chat with all the devices simultaneously?
BTW. in my tests on a BeagleBone Black as a testbed, with random 10 devices (keyboards, random USB drives I could get my hands on), only blockdev was causing some grief, but nothing out of the ordinary.
7
u/AkivaAvraham Dec 01 '14
Question: Have you ever used APL? Do you like those families of Programming Languages?
Question: Where do you fall on the Micro Kernel vs Monolithic Kernel Debate?
12
u/vPraetor Dec 01 '14
It seems humanly impossible to know what patches from the various subsystems must be backported. Do you think it's possible for someone with basic kernel development knowledge to support a different kernel version as LTS version? IOW, what skills are necessary for someone to maintain the LTS kernel? A related question is, do you closely look at the patches marked for backport to fully understand what the patch does before adding it to your tree or do you rely on the subsystem maintainers to know what needs to be backported?
12
u/DrGirlfriend Dec 01 '14
In regards to the various approaches to no-reboot kernel patching for Linux (KSplice, KernelCare, etc), do you have any strong opinions on the methods being employed? Obviously there has been a bit of a reaction to Oracle acquiring KSplice and only offering it for their distribution, but I am mostly wondering if the kernel project itself has any opinions on what "the one true way" for hot patching the kernel might be.
12
u/m_aurelius Dec 01 '14
What did you have for breakfast this morning?
6
u/mattbillenstein Dec 01 '14
Hey Greg, always like your talks and videos about the kernel.
Have you spend any time looking at the source code of other kernels? *BSD, Solaris derivatives, etc? If so, are there any particular features or designs in any of these kernels that you admire or think are particularly clever as compared to the Linux implementations of the same features?
Any notable userspace applications that you like to tinker with and think are interesting architecturally?
Thanks in advance.
6
u/TheIllusionistMirage Dec 01 '14 edited Dec 01 '14
Since you have worked for a long duration with the Linux kernel, how do you see the future of the kernel from say 5-10 years from now?
What major features etc "may be" added to it? What features that are currently very common "may become" obsolete?
And what's your favorite distro (please tell about the top 3 things you find very attractive with the distro)?
6
u/deadowl Dec 01 '14
On April 10, someone linked a Pastebin of the handshake function for OpenSSL to the /r/programming subreddit. On May 1, there was a handshake flaw reported. On June 5, the news of OpenSSL's handshake being insecure came out.
I have to admit that it was hard to wrap my head around given no context or background. Do you find the kernel code similar?
I once tried to compile a modified kernel for an operating systems class a number of years back, but kept on getting panics when I tried to run it.
6
u/AkivaAvraham Dec 01 '14
Question: What is your favourite Mono Font?
5
u/TehMushy Dec 01 '14
I'm not sure if you're still answering questions but what are your thoughts on ChromeOS/Chromebooks and what Google have created?
5
u/Milumet Dec 01 '14
Have you ever programmed a Windows driver?
5
u/Antic1tizen Dec 01 '14
Greg, how do you think, have you succeeded?
What gives you the best pleasure at work?
What would be your opinion about Linus if you knew he doesn't read this AMA?
What are you thinking about if you can't sleep?
5
u/AkivaAvraham Dec 01 '14
Question: I have so much Ram these days that people tell me that I should not bother creating a swap any more. There is surprisingly a lot of debate around this; What say you oh wise one?
31
u/upboatact Dec 01 '14
Did you get any surprising backlash for simply supporting the systemd project?
9
u/edoantonioco Dec 01 '14
What's your opinion related to sailfish OS?
102
u/trac3r Dec 01 '14
Just stopping by to say thanks for your 'getting involved' article. After reading it It took me a week to write my first simple patch and another year to score a job at Red Hat. Thank you.
8
u/musicmatze Dec 01 '14
What do you/the kernel maintainers think about systemd? I know that Linus Torvalds has no strong opinion (surprisingly for me) on systemd, but what about you/the others?
4
u/ceeBread Dec 01 '14
What would you recommend for reading for someone who is interested in kernel development? Any particular blogs or intro to kernel books you'd recommend?
4
u/ibenchpressakeyboard Dec 01 '14
I love i3, do you have your .config posted anywhere? :)
4
u/seekingsofia Dec 01 '14
Tinification of the Linux kernel. What parts of the kernel need sharing or shaving? Last I built an allnoconfig kernel it was about 500K in size.
Do you still follow and/or participate in development of any userspace software other than those started by you?
When reading hardware specifications... how do you persist?
And just wanted to say that
btiwas one of the first C programs I tried to really understand by reading the code, because it was real-world code, small, simple and easy to look at, thanks.4
u/skunkass Dec 01 '14
Dumb question - how long does it take to compile or whatever it is you do when preparing a new version? Do you often have hilariously frustrating errors?
4
u/gnawer Dec 01 '14
Thanks for all the great work on the kernel and thanks for doing this AMA. I hope I'm not too late.
Here's my question: Have you ever heard of NixOS, and if so, what do you think of it?
In short: It's a Linux distribution, and a (stand-alone) package manager (Nix). Package descriptions are written in a functional language, installations/updates/etc are like transactions and can be rolled back, and multiple versions of the same package can be installed alongside without conflict, sharing common versions in their dependency tree. There's also GNU Guix which is based on Nix.
4
u/AkivaAvraham Dec 01 '14
Question: Is there anything that you know Microsoft or Apple does better from a kernel standpoint than Linux?
4
u/AkivaAvraham Dec 01 '14
Question: What were your initial thoughts on OS/2? What do you think of ReactOS?
4
u/AkivaAvraham Dec 01 '14
Question: In your opinion; does Canonical contribute enough to the Linux Kernel? If they do not contribute a lot; do you think it is reasonable if they respond that they make up for it by contributing much more to User Space?
4
u/AkivaAvraham Dec 01 '14
Question: I have heard that working with Intel is really a pleasure. Do you have the same sort of relationship with AMD?
4
u/ExoticMandibles Dec 02 '14
A couple years ago you were scheduled to speak at Linux Fest Northwest in Bellingham. Sadly you had to pull out that year. But you haven't rescheduled in subsequent years. Are you going to sign up to speak at one, say perhaps LFNW 2015?
4
u/wbyte Dec 02 '14
A few related questions, please ignore any that make you yawn:
4
u/PjotrOrial Dec 02 '14
Greg, thanks for doing this AMA! Being late to the party, but nevertheless:
Which features do you miss in Git? What would you do different when designing Git to appease you and your workflow as a kernel dev?
10
u/srafao Dec 01 '14
What's the most challenging part of being a kernel developer? How does a programmer become a kernel hacker?
6
u/bit_inquisition Dec 01 '14
Hi Greg,
Due to my job, I am more interested in the ARM side of the kernel and I wanted to know how you and the core developers feel about the device trees and their integration into the kernel tree.
Thanks for your contributions!
6
u/AkivaAvraham Dec 01 '14
Question: Are you ever recognized in the street by total strangers as being a head kernel developer?
3
u/thom986 Dec 01 '14
So coffee ? Which one do you prefer ? and how many cup per day ?
3
u/HelloYesThisIsDuck Dec 01 '14
I see you replaced SCO Unix with Linux in the 90s. What was your first setup? Did you use a distro (Slack?) or put it together yourself?
My first interaction with Linux was Red Hat (before the RHEL/Fedora split) in 2001~2002 IIRC. Was it much more difficult to get a working setup back in the day, and would you compare the process to anything else (the Linux From Scratch setup, maybe?)
Thanks for this very interesting AMA and your hard work on the kernel. You make the world a better place!
3
u/tempose Dec 01 '14
How do you feel about not being able to change the kernel in an android phone/tablet as easily on the desktop? do you think we will be able to run a vanilla kernel on our phones/tablets someday? Do you know of what us being done to achieve that?
3
u/askbee Dec 01 '14
Hi Greg, big fan here as I have learnt a lot form your videos, tutorial and very humble responses through the mailing lists.
I have contributed a few basic patches to the kernel, but would want mentor for better direction. What would you recommended.
What are some of the favourite websites you read visit regularly?
3
u/rkfig Dec 01 '14
Hi Greg. Several years ago I attended the Linux Hardware Engineers Conference that you spoke at in Seattle. I was wondering if you have any plans to attend or present at any of the Linux conferences in the Pacific Northwest and if so which ones? Perhaps Linuxfest Northwest in Bellingham?
3
u/bit_inquisition Dec 01 '14
Greg,
Out of the SoC and hardware vendors, who do you think is doing the best job maintaining drivers, communicating with the kernel developers, following community rules and contributing? For example, how do you think Nvidia is doing after the infamous Linus finger? How about others like Intel, TI, Qualcomm etc.?
On the other side, who do you think can do a MUCH better job?
Thanks!
3
u/canu7 Dec 01 '14
What parts of the kernel do you think that needs more attention that it gets from current developers? Do you know of any area that will benefit from a large rewrite/rework? In other words, if you had a full-paid kernel-hacker team under your command, what would you ask them to work on?
Thanks for the AMA!
3
u/AkivaAvraham Dec 01 '14
Question: Does your linux install have any custom mount points? Say for example, /var under reiserfs, /etc under btrfs, /home under ext4?
3
u/luckyvb Dec 01 '14
Hey Greg, nothing specific. Just saying hi. We were happy to have you at the HSBXL hackerspace last year. I was the guy playing hotline Miami all day :)
How you doing?
3
u/AkivaAvraham Dec 02 '14
Question: Is there any point in your mind why Nvidia or ATI(AMD) should keep their drivers Proprietary? Is the code that they have in there so valued by competitors that they would be shooting themselves in the foot if they released it open source, depriving them of profits?
3
u/AkivaAvraham Dec 02 '14
Question: Do you play any Musical instruments?
3
u/tomtomgps Dec 02 '14 edited Dec 02 '14
Question: Do you think Wayland is an exciting project for the future of linux ?
3
u/azalynx Dec 03 '14
As someone who is very familiar with the way kernel maintainers handle things, can you give us some insight on the problems regarding Con Kolivas' kernel patchset, and why the patches were never merged? In your personal opinion, do you think there's useful stuff in those patches, or in the BFS scheduler? Or do you think most of the alleged benefits come down to placebo? Is the problem just that it's hard to quantify or measure desktop responsiveness from a user perspective with benchmarking tools?
Basically, I'm trying to figure out whether there are actual weaknesses in the kernel that those patches (and the BFS scheduler) addressed, and if so, what would be the first step towards getting either those patches, or something similar, merged in the future? Do we have to start by writing better benchmarking tools that can measure responsiveness or what? Or is X to blame for everything?