Wednesday, March 17, 2010

Opinion: Certification Matters — Experience Less So — Part 1

October 2, 2008 by Greg Ferro · 21 Comments 

This Post is Part of a Series — click for list on Certification Matters»

I have received a couple of com­ments lately about Certification and tak­ing me to task about my sup­port for cer­ti­fied people. Here’s is Part One of Three (or more) about Certification and why it matters.

My Perspective

I am often involved in help­ing to inter­view and select people for net­work pos­i­tions. Even after Human Remorse has ‘filtered’ the resumes and ascer­tained that people match the pos­i­tion cri­teria, there are still thirty to fifty resumes for a single pos­i­tion. How do I make that judge­ment ? What cri­teria can I use to select someone who has tech­nical competence ?

While I can agree that:

  1. passing an exam doesn’t neces­sar­ily make good engin­eers1
  2. good engin­eers might have achieved qualification
  3. there is no replace­ment for exper­i­ence on the job2
  4. there are other skills that a make a good employee

its not that simple.

Let me dis­cuss a few points about cer­ti­fic­a­tion that you may not have thought about if this is your viewpoint.

“I have equi­val­ent Experience”

I recently inter­viewed someone who claimed to have CCIP and CCSP level of expert­ise. His resume didn’t really sup­port that, but he did have enough exper­i­ence to sug­gest that he might be telling the truth.

So my first tech­nical ques­tions was about MPLS, but he had no exper­i­ence of that. And he had done no study of the topic. My second ques­tion was about QoS, but he had no exper­i­ence of that either. So I moved onto Security ques­tions, he had some fire­wall exper­i­ence but no exper­i­ence or know­ledge of IPS sys­tems, Content Filtering or Application Proxies.

So now, I have a can­did­ate who claims to be a Network and Security Specialist, but has no fun­da­mental know­ledge of MPLS, IPS, SSL VPN or QoS. And abso­lutely no exper­i­ence of these top­ics. The pro­cess of fin­ish­ing a CCSP3 tells me that you should have learned all of these Security top­ics, and CCIP means you should know a fair bit about QoS and MPLS.

Experience teaches you about things you know or need to know. Certification forces you to learn things that you don’t know, or haven’t needed in your cur­rent job. This is import­ant because the next job will be dif­fer­ent, and have dif­fer­ent meth­ods or tech­no­logy. I don’t want to teach you what you don’t know becuase there isn’t enough time in the real world.

A friend of mine summed it up this way “If you have five years of exper­i­ence in one job, then you have five times one year exper­i­ence”. Repeating the same tasks is not exper­i­ence, you need to learn new things to be valu­able out­side of your cur­rent company.

Study meth­ods matters

One of the areas that is not well under­stood, is that if you rely on exper­i­ence as your best skill you are show­ing that you can­not, or will not, study. That is, you are not good with text­books and learning.

There are many jobs where someone who does repet­it­ive work is needed, but there are many more jobs where the per­son needs to be mov­ing fast to keep up, to gain new know­ledge. It is your choice as to which you choose. But I don’t want to be hand feed­ing you, I want someone who can learn on their own, using the Cisco web site and some text­books. As a work­mate, I am per­fectly will­ing to spend time work­ing on some­thing that you are strug­gling with, but I abso­lutely do not want to be teach­ing you OSPF link state announcements.

Its your choice

Now, if you can­not, or will not, pick up a text book or web site and learn new stuff then that is a career choice. You have chosen a path that, most likely, has no pro­gres­sion and lim­ited oppor­tun­it­ies for pro­mo­tion. And it is human nature that you will think that exper­i­ence mat­ters more than cer­ti­fic­a­tion, but you are mostly wrong.

On the other hand, if you want to move onwards and upwards to face new sys­tems and con­fig­ur­a­tions, the fast­est way is to start learn­ing. Make sure that you are learn­ing the things you don’t know because that’s the next job.

Other Articles in this series

Certification Matters — Knowledge or Experience Which is more valu­able ? Part 2

Certification Matters — Only you can do the Study Part 3

Certification Matters — Exams are not rel­ev­ant to Real Life — Part 4

Footnotes

  1. Yassin Perriman here [back]
  2. (2) Anonymous on a recent post [back]
  3. Cisco Certified Security Professional [back]

Please rate this post:

  Why Rate Posts?
1 Star - It\\\'s Crud2 Stars - It\\\'s Tosh3 Stars - Something\\\'s missing4 Stars - Needs works5 Stars - Good Enough6 Stars - Good7 Stars - Excellent8 Stars - Brilliant9 Stars - Astonishing10 Stars - Awesomely Godlike? (No Ratings Yet)
Loading ... Loading ...

Comments

21 Responses to “Opinion: Certification Matters — Experience Less So — Part 1”
  1. Jeff Darcy says:

    “One of the areas that is not well under­stood, is that if you rely on exper­i­ence as your best skill you are show­ing that you can­not, or will not, study. That is, you are not good with text­books and learning.”

    Assumption 1: know­ledge based on exper­i­ence can­not exceed that gained from text­books (if it could than some­body who was per­fectly able to study and had even done so might still have exper­i­ence as their best skill)

    “There are many jobs where someone who does repet­it­ive work is needed”

    Assumption 2: exper­i­ence = repetition

    “Now, if you can­not, or will not, pick up a text book or web site and learn new stuff then that is a career choice.”

    Assumption 3: learn­ing comes only from books and web sites

    What bol­locks. Yes, we all know you’re cer­ti­fied (some might say cer­ti­fi­able) and proud of it. One could hardly read this blog and not know that. Unfortunately, your pride in your own accom­plish­ments in class does not in any way jus­tify your obvi­ous dis­dain for oth­ers’ accom­plish­ments in the field. Sometimes “text­books and web­sites” are the best or most effi­cient way to learn some­thing, some­times actu­ally work­ing with (or imple­ment­ing) it is. In the par­tic­u­lar case of work­ing with, or espe­cially invent­ing, new tech­no­lo­gies there are no classes or cer­ti­fic­a­tions and exper­i­ence is the *only* way to under­stand it. I know some of the people who inven­ted MPLS and SSL, exper­i­ence is clearly their best skill, but appar­ently you — a mere user of their tech­no­logy — would assume that its invent­ors can­not or will not study. Some people do have the pro­ver­bial “one year of exper­i­ence repeated ten times” and oth­ers have ten — or twenty or even thirty — years of genu­ine ever-​​varying exper­i­ence and ever-​​increasing know­ledge that no text­book can match. Who do you think writes those text­books and cer­ti­fic­a­tion cur­ricula anyway?

    Certication can ensure a par­tic­u­lar level of know­ledge across a par­tic­u­lar range of sub­jects. There’s value in that, and we could reas­on­ably argue over whether that level rep­res­ents the 10th or 75th per­cent­ile in their field, but nobody — *nobody* — reaches the 90th per­cent­ile with only book learn­ing and quite a few man­age it without any kind of cer­ti­fic­a­tion. Certification is the path upward for those who can’t find or make their own path, and it never leads to the summit.

  2. Greg Ferro says:

    Derogation 1 — I said “rely on exper­i­ence as your best skill” does not inter­pret as “know­ledge based on exper­i­ence can­not exceed that gained from text­books”. My point is that exper­i­ence alone is not enough. The extra­pol­a­tion is your own and not mine.

    Derogation 2 — If you are con­tent with repeat­ing the same exper­i­ences, and pro­gress­ing slowly in your career (and which is a choice that many people make), then exper­i­ence only will work in your life.

    Derogation 3 — “learn­ing comes only from books and web sites” that state­ment is fac­tual. It does not exclude the belief that learn­ing comes from exper­i­ence, and such fun­da­mental fact must be inher­ently assumed.

    Jeff — the title of the art­icle is “Certification Matters — Experience Less So”, thus lead­ing you on to the hypo­thesis that Certfication AND Experience are required. My point is that cer­ti­fic­a­tion clearly demon­strates that you CAN study and WILL study.

    As an employer, I will not take the time to dis­cover what you are cap­able of, I will auto­mat­ic­ally preselect can­did­ates. Those without cer­ti­fic­a­tions will auto­mat­ic­ally be bypassed for many roles, and even if they may have been the best per­son for the job, becuase there are equally too many time wasters who “think” they are talented.

    Certification will open the doors for you but only you can walk through it. You are cor­rect that “Certification is the path upward for those who can’t find or make their own path, and it never leads to the sum­mit.” but equally, many people without cert­fic­a­tion plans don’t know, or unable to struc­ture them­selves to walk the path. Your state­ment cuts both ways.

    I am not derog­at­ory about exper­i­ence based learn­ing, its just very hard to detect who has it. I cer­tainly don’t have time to go look­ing for it, and thus don’t bother.

  3. Jeff Darcy says:

    “I am not derog­at­ory about exper­i­ence based learning”

    Yes, you were. Trying to imply that those who have more exper­i­ence than certification-​​based know­ledge “can­not, or will not, study” is derog­at­ory. Characterizing their exper­i­ence as “repet­it­ive work” and “a path that, most likely, has no pro­gres­sion and lim­ited oppor­tun­it­ies for pro­mo­tion” is derog­at­ory. Denying your obvi­ous con­tempt for those not exactly like your­self only fur­ther insults read­ers’ intelligence.

    “its just very hard to detect who has it. ”

    It’s harder than find­ing an acronym on their resume, but not really hard in the grand scale of Things That Are Hard. As an exper­i­enced engin­eer, I’m fairly con­fid­ent in my abil­ity to determ­ine which skills are rel­ev­ant to the job I’m inter­view­ing them for, and to what degree the can­did­ate has them. As an exper­i­enced engin­eer who tends to work on the bleed­ing edge, I’m also pretty inter­ested in whether they have a more gen­eral abil­ity to develop skills in tech­nical areas where no cer­ti­fic­a­tion courses, text­books or web­sites exist. Certification can in fact seem like a neg­at­ive in many cases, as there are only so many hours in a day and time spent study­ing mature tech­no­lo­gies is neces­sar­ily time not spent learn­ing or extend­ing new ones. As an employer, I gen­er­ally have little use for those who can only walk a path that thou­sands of oth­ers have pre­pared for them.

  4. Greg Ferro says:

    After recently work­ing my way through more a hun­dred resumes, I am con­fid­ent that it isn’t pos­sible to pick out those who have skills. Many of those resumes were awful. To improve my life, I filtered accord­ing to Certifications. If you don’t have it, you don’t make the list for interview.

    Now, the inter­view is where I would pick the per­son who has exper­i­ence and the skill to apply it. Easy to work it out there.

    On that basis, given, say, a hun­dren resumes, how do you identify “exper­i­ence” that is worthwhile ?

  5. Jeff Darcy says:

    “given, say, a hun­dren resumes, how do you identify “exper­i­ence” that is worthwhile ?”

    There’s no simple answer, but there are cer­tainly things you can see pretty quickly from a resume. For starters, if you have a list of tech­no­lo­gies that you think are rel­ev­ant to the pos­i­tion you’re filling, it takes less than a minute per resume to see how many are even men­tioned. Take the top half based on that, leav­ing assess­ment of depth in each area until a later stage. To gauge gen­eral abil­ity to pick up and learn new things, you can look at how long they’ve stayed at each job, how many pro­jects they’ve worked on at each, how rap­idly they’ve been pro­moted or given new respons­ib­il­it­ies. Probably a bit more than a minute each this time, but if you take the top half again you’ve prob­ably nar­rowed the field to 25 in under three hours so far, or you can make each cut a bit deeper if you want to be hasty about things.

    At this point you can spend a little more than a minute per resume, and skim each to gauge qual­ity (or cred­ib­il­ity) of exper­i­ence in each area of interest. They say they worked with tech­no­logy XYZ, do they? For how long? From what you know of the com­pany in ques­tion, plus what they say of the pro­ject and their own role in it, does it sound like the tech­no­logy was cent­ral to their work or was it more peri­pheral? Clearly some­body who worked for a year on a pro­ject that dir­ectly involved XYZ, at a com­pany where XYZ was a part of their core value prop, is likely to know more about it than if XYZ was merely peri­pheral to their pro­ject and com­pany for three months. You can also use this inform­a­tion to gauge whether they’re a “jump on raw new tech” kind of per­son or a “per­fect the old tech” kind of per­son, whether they’re bet­ter at the begin­ning or end of a pro­ject, bet­ter at work­ing inde­pend­ently vs. part of a team, and so on, match­ing those qual­it­ies vs. your spe­cific needs. Still, we’re talk­ing maybe three minutes per resume, so maybe another hour total to find the ten or so who are at least worth a quick phone screen or call to your friend who worked with them.

    Does half a day to review a hun­dred resumes sound like too much? Well, how import­ant is it to hire the right people? Besides, you prob­ably shouldn’t be deal­ing with a hun­dred resumes your­self any­way. If it’s not an entry-​​level pos­i­tion and you spe­cified it prop­erly, your pile will be way smal­ler to start with. If you have other senior col­leagues, you should be split­ting the pile with them. Lastly, if it’s still too much, you should find a good headhunter and train them to do that first pass prop­erly. Good headhunters are rare, and you can’t really trust any of them to do the second pass right, but there are a few who can add some real value to the pro­cess. What about fees, you say? Well, if you’re hir­ing for such a gen­eric pos­i­tion *and* there’s no trust between you and your col­leagues *and* your own time is too pre­cious to spend doing this very import­ant part of your job *and* you still want to be very picky about who you hire (des­pite it being a gen­eric pos­i­tion) then you’ve kind of left your­self no other options and the headhunter’s fee has to be weighed against the cost of fail­ing to hire any­one at all.

  6. Dedan says:

    I hate to get between you too but here is my take. i too have inter­viewd and worked with people with way more exper­i­ence than myself. I ended up being very shocked at lheir lack of lnow­ledge and their lack of study on the stuff they ahd to know I was going to ask. so, fil­ter­ing by cert is a quick way to at least give you a baseline of what they should know.

    i am one of those cer­ti­fied folk. I was an officer in the US Navy and a pilot until last year. I taught myself net­wok­ing though I have a BS in com­puter engin­eer­ing. I have a CCNP and have passed the CCIE writ­ten. I have blown people away at tech­nical inter­views with what I know as com­pared to what my exper­i­ence says I should know. If exper­i­ence is the only met­ric how is any­one ever sup­posed to get hired for anything?

    I have man­aged over 100 people. I have been an air­craft com­mander in 4 dif­fer­ent air­craft includ­ing car­rier based plat­forms. I have been respons­ible for lives. I have got­ten to my cur­rent level of know­ledge while doing all that and never hav­ing a job that would have helped me learn or going to any course. I didn’t get an IT job until the first quarter of 08 because of my exper­i­ence. If exper­i­ence is all you look at you will miss those of us whose resumes look like mine and are com­mit­ted to con­stant learn­ing and under­stand the need to adapt and over­come. Experience will come, but if someone has the know­ledge but won’t take a test, what does that say?

  7. Dedan says:

    for­give any mis­spellings, I used my phone.

  8. Jeff Darcy says:

    “Won’t take a test”? It’s not just a mat­ter of walk­ing in and sit­ting down, as you well know. Some people really do have bet­ter things to do than study the vendor-​​specific ques­tions that will appear on any vendor-​​administered test, not to men­tion the $315 writ­ten and $1400 lab fees, even if they know ten times more than the test requires in some areas. I’m not say­ing that exper­i­ence is the only met­ric or that cer­ti­fic­a­tion is com­pletely worth­less, but the whole thesis of this thread seems to be the equally silly and offens­ive con­verse of that. Ignoring exper­i­ence to fil­ter resumes by let­ter group­ings is insane. It’s a good way to fill your team with people whose know­ledge and strengths are redund­ant instead of com­ple­ment­ing one another, and that’s not likely to be a very effect­ive team.

    Of course people who have paper but not exper­i­ence will preach about the paper’s value. Not only do they not want to feel like suck­ers for hav­ing made that expendit­ure, but they have a ves­ted interest in pro­mot­ing the brand that it rep­res­ents. When I see someone with some actual cred­ib­il­ity tout­ing the value of vendor cer­ti­fic­a­tion (MS pulls the same stunt and I’ll bet you guys don’t feel *their* cer­ti­fic­a­tions trump exper­i­ence) I’ll let you know. Don’t wait up.

    • Dedan says:

      I am not preach­ing about the value of the paper no do I feel like a sucker for any­thing. I accept the import­ance of exper­i­ence and I don’t feel like I was cheated because another per­son was hired. But basing everything on exper­i­ence basic­ally says that if a per­son hasn’t done some­thing for a couple of years they can’t do it. I don’t think the author was say­ing exper­i­ence was worth­less, only that there’s no way to really tell what someone’s exper­i­ence level is without inter­view­ing them which for him was too time con­sum­ing con­sid­er­ing his exper­i­ences with it.

      As far as bet­ter things to do than study and not want­ing to spend the money, why go to col­lege? Way more time and more money and no exper­i­ence. So col­lege gradu­ates are suck­ers too?

      No one that I know who has a CCIE feels like they were suckered nor do the salar­ies they get paid sup­port the idea that they are. I do feel that if you have equi­val­ent exper­i­ence you have the upper hand. Your job rein­forces what you have to know and if you sup­ple­ment it with some time and com­mit­ment you have the best of both worlds.

  9. mewcomm says:

    Simply the best most reasoned know­ledge worker val­id­a­tion post I’ve ever read.

    Anti-​​intellectualism is wide spread and grow­ing in the U.S. — Certifications of any kind are usu­ally opposed, often ridiculed and sel­dom embraced. And I am such a Pollyanna.…I’m always sur­prised at the bit­ter rhet­oric of the opponents!

    Is not learn­ing fun? Satisfying? Empowering? To many it is a bur­den and to be avoided. And in a glo­bla­ized inform­a­tion eco­nomy those who don’t learn are irrelevant.

    Thanks

    • Greg Ferro says:

      Thankyou very much. Given that I am part of a group of hihgly intel­lec­tual people, I for­get that not every­one regards know­ledge as exciting.

      Good point about learn­ing being fin and excit­ing too.

  10. Great idea to write about this. I wish recruit­ers would think the way you do :) .

    • Greg Ferro says:

      Recruiters under­stand the job mar­ket, they don’t under­stand the actual jobs them­selves. Remember recruit­ers are just out­sourced func­tions of the HR depart­ment. On this basis, you should take the time to teach them, and then you will get a bet­ter response.

Trackbacks

Check out what others are saying about this post...
  1. […] Greg at Ethereal Mind pos­ted an inter­est­ing art­icle about cer­ti­fic­a­tions vs. exper­i­ence at Ethereal Mind. […]

  2. […] my first post Opinion: Certification Matters — Experience Less So — Part 1 I star­ted a series of posts about cer­ti­fic­a­tion. In the com­ments on the post, “Dedan” […]

  3. […] One Certification Matters — Experience Less So of this art­icle can be found […]

  4. […] Certification Matters, Experiences Less So — Part 1 Certification Matters — Knowledge or Experience Which is more valu­able ? Part 2 Certification Matters — Only you can do the Study Part 3 […]

  5. […] One Certification Matters  —  Experience Less So of this art­icle can be […]

  6. […] Certification Matters, Experiences Less So  —  Part 1 Certification Matters  —  Knowledge or Experience Which is more valu­able ? Part 2 Certification Matters  —  Only you can do the Study Part 3 […]

  7. […] topic and worth put­ting some ideas down here and hav­ing a dis­cus­sion. In my first post Opinion: Certification Matters  —  Experience Less So  —  Part 1 I star­ted a series of posts about cer­ti­fic­a­tion. In the com­ments on the post, […]



Speak Your Mind

Tell us what you're thinking...
and oh, if you want a pic to show with your comment, go get a gravatar!