A Lengthy Exercise

by Mark

I’ve just spent a few days living like an undergraduate; and I loved it!

For most of us, the path to a scientific paper is an extremely nonlinear one, as Sean described in his recent trilogy (I, II, III). In a collaboration this is compounded by the fact that (for theorists at least) there are several people working simultaneously. These people are calculating independently at times, mixing notations, making their own approximations, using their favorite techniques, and writing things their own ways. Regular meetings, either in person, or on video or teleconference calls then hopefully iron out the differences.

While collaboration has some of the drawbacks above, it has many positives, not least of which is the creativity and array of technical skills that several people can bring to an initially ill-formed idea. But perhaps the main reason I love collaborating, and choose to do it so often, is that I truly enjoy the process. Discussing fascinating physics with talented colleagues is a delightful part of my job, and I wouldn’t give it up for the world. So whether someone comes to me with an idea they want to discuss, or I have a good idea of my own, I frequently take advantage of having other scientists with common interests around, and more often than not collaborate.

However, one thing that one needs to do in any collaboration is to check all the equations independently. Much of this checking is ongoing as the project progresses, but sometimes you take something complicated that a collaborator has done on faith in order to push ahead and see where an idea is going, coming back later to double check the details. This has been the process in many of my collaborations, and it is a perfectly enjoyable and rigorous way to work. One checks everything, of course, but not in order, and not in one continuous sitting.

In the last week, however, I got to do something unusual, for me at least. One lengthy collaborative paper I’m working on is nearing completion and I realized that there were a number of these technical results that I needed to go over in detail. But in this case, I also felt that the paper was getting sufficiently long, and we’d changed notations sufficiently many times, that the structure of the equations appearing in the draft (but not the ideas, or the heart of the calculation, of course) had become a little murky to me. So I decided to sit down with our draft and go through every single calculation, from the beginning, to make sure not only that I checked the things I hadn’t checked before, but also that I was completely happy with the notation, the structure, and the arguments. Usually this isn’t required at this stage, but here I really felt I’d benefit from it.

And it turned out to be remarkably nostalgic fun, as well as practically useful for our paper! You see, I hadn’t quite thought of it this way, but working through a draft like this is rather like an extreme, lengthy version of the kinds of initial parts of exam questions one gets as a student. You know the kind – the ones that start

Show that such and such a result is true. Now, using this result and such and such a definition, do such a transformation and thereby prove that this unlikely looking expression is true. Interpret this in the light of this interesting observation.

This kind of problem tests a certain skill set, but not necessarily the same one that one uses to make progress on problems to which one doesn’t know the answer. It can be a bit like working out to build muscles that will be useful for a particular sport. The muscles will definitely help, but unless you have the actual skill to play the game itself, they will only get you so far.

Too many of these kinds of exercises can be dreary indeed. Nevertheless, for me there was always a bit of a thrill to sitting down in front of a clean and empty pad of paper and working my way through a maze of reasoning to get to the required answer. I’d typically hit a dead end several times before figuring out a correct strategy, and those dead ends invariably taught me something deep about problem solving in general, and the specific physics or mathematics at hand.

In this case, my task turned into the equivalent of a three day exam, with the end result being thirty or more pages of calculations (and I write quite small and neatly – yes, I am extremely anal), and a couple of Maple worksheets to help me check various approximations. I had little boxes around important results and everything. It was just like being a student again, although wasn’t accompanied by vats of coffee and a late night run to the college bar for a quick pint at last orders.

Luckily nothing major was wrong, although I found a number of typos and one missing term. However, my picture of what we’ve done is now much clearer and more coherent. It is unlikely that I’ll do anything so formally organized with many future papers, but this was such fun! It almost made me want to take a class in something technical I don’t know much about, before reality crashed in and I realized that I basically have negative time to devote to anything like that.

I probably should have been more clear at the beginning of this post – I was living the working life of an undergraduate. Hope you weren’t looking for stories of drinking games, walks of shame and quick bong hits before class, although I do hear those are the subject of Daniel’s next post.

submit to reddit

August 8th, 2007 9:00 AM
in Science | 10 comments | RSS feed | Trackback >

10 Responses to “A Lengthy Exercise”

  1. 1.   Neil B. Says:

    Hi, good luck with publication. I am indirectly affiliated with research institutions here in SE Virginia, and don’t have the same privileges as the regulars. I want to submit some papers in the usually approved LaTeX format, but don’t have access to any but “public”/commercial composing or conversion SW. I already have some docs in Word, that I want to convert adequately. When I downloaded Word2Tex it didn’t seem to install properly. I also want to compose in LaTeX, but admit to being lazy: I’d rather type in and have the SW do the composing. Thanks for any tips you can offer. In justifying my comment, this subject should be useful to many readers (since we’ve had lots of discussion of paper writing, judging, collaborating, etc. but I don’t recall much about the technical issues.)

    PS: I remember, back in the 80s I got complements for my very nicely hand-written Greek etc. symbols, but now that’s a lost art. (Some journals supposedly still, or recently did, accept hand-typed or even hand-written articles for the sake of contributors from third-world countries.)

  2. 2.   Count Iblis Says:

    Neil, Physical Review accepts documents in MS Word format.

  3. 3.   Tez Says:

    I would hope that any of my papers are such that an expert in the field (as I’d expect a co-author to be) would not have to spend three days trying to redo the calculations (especially not having to try and “find the right path” as you seem to describe.) I think the path to follow should at least be described in sufficient detail that “hitting dead ends” and “finding a strategy” are unnecessary!!

  4. 4.   Count Iblis Says:

    Tez, I agree about the co-authors, but readers will have to do more work. You cannot show all the details in the paper. I actually once received a referee report that said that I had explained things in too much detail. The referee wanted me to revise the paper and cut back drastically on the maths. :)

  5. 5.   Jason Dick Says:

    By the way, Neil, in my experience people in the scientific community also use nothing but public software for composing LaTeX. I use emacs under Linux (you can also run it under cygwin in Windows), along with a few style files that you can nab from the source of uploaded papers.

  6. 6.   Mark Says:

    Indeed Tez, and that’s one reason going through in this way is particularly useful – one gets to see where laying out more detail is helpful and, in fact, where one is spending too much time explaining something. Often these dead ends arise where the related calculations of two collaborators come together and more interim explanation is required.

    Having said that, even going through moderately well-explained papers can take some time, even for an expert, if you want to get ever factor of 2 and multiple of 2\pi correct.

    Neil, what Jason Dick said is what I’d have said – it is all free software that most people use.

  7. 7.   daniel Says:

    I was all ready to regale everyone with wild tales from my undergraduate days. But, sadly, most of what I remember involved precisely these sorts of physics exercises. Graduate school, on the other hand…no, those tales are best left unwritten.

  8. 8.   Yvette Says:

    Glad to hear you go through the paper alright! Somehow I think I’ll have more fun with the “show” problems when they’re no longer in exam situations, though. ;)

  9. 9.   Allyson Says:
  10. 10.   Eugene Says:

    I remember my Quantum Fridays of my graduate school days. Where every Friday evening, I would sit down with my weekly Quantum Mechanics (year 1)/Quantum Field Theory (year 2)/String Theory (year 3) homework set and work through them till (a) they were done or (b) I dropped dead from exhaustion.

    Ah, Quantum Friday. How I don’t miss thee!