Pre-Coding Checklist: Things Everybody Hates, but Everybody Needs Them Too. From Source Control to Coding Guidelines

 
Author:  Follow: TwitterFacebook
Job Title:Sarcastic Architect
Hobbies:Thinking Aloud, Arguing with Managers, Annoying HRs,
Calling a Spade a Spade, Keeping Tongue in Cheek
 
 
Developer's toolbox

[rabbit_ddmog vol=”3″ chap=”Chapter 11 from “beta” Volume III”]

We’ve discussed a lot of architectural issues specific and not-so-specific to MMOs, and now you’ve hopefully already drawn a nice architecture diagram for your multiplayer game.

However, before actually starting coding, you still need to do quite a few things. And I am perfectly aware that there are lots of developers. Let’s take a look at them one by one.

IMPORTANT UPDATE: discussion on Source Control Systems below does not really reflect realities specific to gamedev (and neither reflects recent improvements in SVN). For an updated version of the discussion on Source Control in the context of gamedev, please see Version Control Branching for gamedev and Choosing Version Control System for gamedev. For the rest of this post – please skip to CI section below

Source Control System

Threatening hare:I don't want to go into a discussion why you need source control system, just saying that there is a consensus out there on it being necessaryTo develop pretty much anything, you do need a source control system. I don’t want to go into a discussion why you need source control system, just saying that there is a consensus out there on it being necessary for all the meaningful development environments. Even if you’re single developer, you still need source control: the source control system will act as a natural backup of your code, plus being able to rollback to that-version-which-worked-just-yesterday, will save you lots of time in the long run. And if you’re working in a team, benefits of source control are so numerous that nobody out there dares to develop without it.

The very first question about source control is “what to put under your source control system?” And as a rule of thumb, the answer is like

You should put under source control pretty much everything you need to build your game, but usually NOT the results of the builds

And yes, “pretty much everything” generally includes assets, such as meshes and textures.

On the other hand, as with most of the rules of thumb out there, there are certain (but usually very narrow) exceptions to both parts of this statement. For “pretty much everything” part, you MIGHT want to keep some egregiously large-and-barely-connected-to-your-game things such as in-game videos outside of your source control system (for example, replacing them with stubs), but such cases should be very few and far between. Most importantly,

the game should be buildable from source control system, and the build should be playable

, that’s the strict requirement, other than that – you MIGHT bend the rules a bit.

For not including results-of-your-build – I’ve seen examples when having YACC-compiled .c files within source control has simplified development flow (i.e. not all developers needed to setup YACC on their local machines), but once again – this is merely a very narrow exception from the common rule of thumb stated above.

Git

Surprised hare:Even I myself, being a well-recognized retrograde, has been convinced that git has enough advantages to qualify as “the way to go”The next obvious question with regards to source control is “Which source control system to use?”. Fortunately or not, there is a pretty much consensus about the-best-source-control-system-out-there being git.1 Even I myself, being a well-recognized retrograde, has been convinced that git has enough advantages to qualify as “the way to go” for objective reasons (opposed to just being a personal preference).

Whether to host git server yourself or whether to use some third-party service such as github – is less obvious, especially for games. I would say that if by any (admittedly slim) chance your game is open source – you should go ahead with github.2

If your game is closed-source (which is most likely the case) – then the choice becomes less obvious, and depends on lots of things: from the size of your team to having on the team somebody who’s willing to administrate (and backup!) your own git server (while it is certainly not a rocket science, it will involve some command-line stuff). Even more importantly, if your game has lots (such as multiple gigabytes) of assets – you probably should settle for an in-house git server, at least because downloading all that stuff over the Internet will take too much time. On the other hand – for private third-party-hosted Git repositories you have more choice than for public ones (with GitLab and BitBucket, in addition to github, traditionally being among the top contenders); BTW, if you happen to like UI of GitLab or BitBucket but don’t trust your code to anybody3 – keep in mind that you can have them installed in-house (a.k.a. “self hosted”) too.


1 Actually, you can do more or less the same things with Mercurial, but unless you already have it in place, in most cases I suggest to stick with git, even in spite of Git’s lack of support for locks, see “Git and unmergeable files” section below
2 NB: while BitBucket and GitLab have their own free offers, I am still not convinced that they won’t evaporate (or become restricted to the point of being outright unusable) overnight. In particular, the following quote from GitLab site about their Free Plan is very annoying: “In addition to the features below currently this plan still has many of the Silver features, these Silver features will be deactivated over the coming months.”
3 a prudent assumption, BTW; 3rd-party hosts such as GitLab or BitBucket are very juicy attack targets, and as we as gamedevs need to rely on “security by obscurity” – the damage from some-hacker-cracking-into-GitLab-or-BitBucket-and-publishing-all-the-source-code-found will be enormous

 

Git and unmergeable files

For game development (and unlike most of other software development projects), you’re likely to have binary files which need to be edited. More precisely, it is not only about binary files, but also includes any file which cannot be effectively merged by git. One example of these is Unity scene files, but there are many others out there (even simple text-based Wavefront .obj is not really mergeable).

A question “what to do with such files” is not really addressed by Git philosophy. The best way would be to learn how to merge these unmergeable files,4 but this is so much work that doing it for all the files your artists and game designers need, is hardly realistic 🙁 .

The second best option would be to have a ‘lock’ so that only one person really works with the asset file at any given time. However, git’s position with regards of locks is that there won’t be mandatory locks, and that advisory locks are just a way of communication so that should be done out-of-git (!). The latter statement leads to having chat channels or mailing lists just for the purposes of locking (ouch!). I strongly disagree with such approaches:

all stuff which is related to source-controlled code, SHOULD be within source control system, locks (advisory or not) included

To use advisory (non-enforced) locks in git, I suggest to avoid stuff such as chat channels, and to use lock files (located within git, right near real files) instead. Such a lock file MUST contain the name (id) of the person who locked it, as a part of file contents (i.e. having lock file with just “locked” in it is not sufficient for several reasons). Such an approach does allow to have a strict way of dealing with the unmergeable files (that is, if people who’re working with it, are careful enough to update – and push(!) – lock file before starting to work with the unmergeable file), and also doesn’t require any 3rd-party tools (such as an IM or Skype) to work. For artists/game designers, it SHOULD be wrapped into a “I want to work with this file – get it for me” script (with the script doing all the legwork and saying “Done” or “Sorry, it’s already locked by such-and-such user”).5 If you like your artists better than that, you can make a shell extension which calls this script for them.

The approach of lock-files described above is known to work (though creating commits just for locking purposes), but still remains quite a substantial headache. Actually, for some projects it can be so significant that they MIGHT be better with Mercurial and it’s Lock Extension (which supports mandatory locking).

Let’s note that there is also an issue which is often mentioned in this context, the one about storing large files in git, but this is a much more minor problem, which can be easily resolved (for example, by using git LFS plugin).


4 Actually, for merging Unity scene files there was an interesting project [GitMergeForUnity], but it seems abandoned now 🙁
5 and of course, another script “I’m done with file”, which will be doing unlock-and-push

 

Git and 3rd-party Libraries

Hare asking question:How to handle those 3rd-party libraries you're going to use?One subtle issue with regards to source control system is how to handle those 3rd-party libraries you’re going to use. Ideally, 3rd-party libraries should be present in your source control system as links-pointing-to-specific-version of the library, with your source control system automagically extracting them before you’re building your game. It is important to point to a specific version of the library (and not just to head), as otherwise a 3rd-party update can cause your code to start crashing, with you having no idea what happened. On the other hand, such an approach means that it is your responsibility to update this link-to-specific-version to newer versions, at the points when you’re comfortable with doing it.

git submodule does just that, and git submodule update will allow you to update your links to the most recent version of the 3rd-party library. However, it works only when your 3rd-party libraries are git repositories themselves

If your 3rd-party library is available as an svn repository instead of git – you may setup a git mirror of svn repository and then to use git submodule [StackOverflow.SvnAsGitSubmodule]. A similar trick can be used with Mercurial too (see [HgGitMirror] on creating git mirror from Mercurial).

And if you’re using a non-open-source library – you’ll probably need to put a copy of it under your source control system 🙁 .

BTW, about open-source and non-open-source 3rd-party libraries: there is another (even more important) issue with them, make sure to read “3rd-party Libraries: Licensing” section below.

Git Branching

Hare pointing out:One of the things you need to decide when using git, is how do you work with branchesAs noted above, as a rule of thumb, you should be using git. And one of the things you need to decide when using git, is how do you work with branches. In pre-git source control systems, branching was a second- (if not third-) class citizen, and developers were avoiding branches at all costs. In git, however, everything is pretty much about branches, and in fact this ease-of-branching-and-merging is what gives git an advantage over svn etc.

IMO, most of the time you should be following the branching model by Vincent Driessen described in [GitFlow] and is known as “Git Flow”. When you look at it for the very first time, it may look complicated, but for the time being you’ll just need a few pieces of it:

  • master branch. As a rule of thumb, you should merge here only when milestone/release comes. All the commits to the master branch should come from merges from develop branch. Direct commits (i.e. commits which are not merges from develop) into master branch SHOULD NOT happen.
  • develop branchThe branch which is expected to work. More precisely – it is usually understood as a branch that compiles and passes all the automated tests, though it is understood that no amount of automated testing can really guarantee that it is working. You should merge to develop branch as soon as you’ve got your feature working “for you” (and all the automated regression tests do pass). Direct commits (not from feature branches) into develop branch are usually allowed. On the other hand, leaving develop branch in a non-compilable or failing-automated-test state is a major fallacy, and you’ll be beaten by fellow developers pretty hard for doing it (and for a good reason). Note that having develop branch temporary failing to compile or run tests (in a sequence like developer committed to develop – automated build failed – developer fixed the problem or reverted the merge6) is not considered a problem; it is leaving develop branch in unusable state for several hours which causes a backlash (and rightly so). More on it in “Continuous Integration” section below.
  • Hare thumb down:There is a breed of developers out there who prefer to live within their own feature branch for many weeks and months, implementing many different features under the same branch and postponing integration as long as they canfeature branchYou should create your own feature branches as you develop new features. These feature branches should be merged into develop branch as soon as your feature (fix, whatever) is ready. Consider feature branch as your private playground where you’re developing the feature until it is ready to be merged into develop branch. Feature branches are generally not required even to compile.
    • A note of caution: there is a breed of developers out there who prefer to live within their own feature branch for many weeks and months, implementing many different features under the same branch and postponing integration as long as they can. This is a Bad Practice™, and a rule-of-thumb of one-feature-for-one-feature-branch should be observed as soon as you’ve past your very first milestone.
    • It is also interesting and useful to note that modern source control systems (git included) tend to punish those who do their merges later. When both you and a fellow developer are working on your respective branches, and she got committed her merge 5 minutes before you, then it becomes your problem to resolve any conflicts which may arise from the changes both of you have made. In most cases for a reasonably mature codebase, there won’t be any conflicts, but sometimes they do happen, and
      it is the second developer who becomes a rotten egg responsible for resolving conflicts
      Print this profound truth in a 144pt font and post it on the wall to make your fellow developers merge their feature branches more frequently.

6 not that revert of the merge in git is very peculiar and counter-intuitive, see [kernel.RevertFaultyMerge] for discussion

Continuous Integration

One thing which is closely related to source control, and which you should start using as soon as possible for any sizeable project, is Continuous Integration a.k.a. CI (not to be confused with Continuous Deployment, a.k.a. CD which is a very different beast and will be discussed in Chapter [[TODO]]).

Hare with an idea:The basic idea behind Continuous Integration is simple: as soon as you commit something, a build is automatically run with all the tests you were able to invent by that timeThe basic idea behind Continuous Integration is simple: as soon as you commit something (usually it applies to develop branch merges/commits as described above), a build is automatically run with all the tests you were able to invent by that time. If the build or tests fail – whoever made the “bad” commit, gets notified immediately.

In a sense, continuous integration is an extension of a long-standing practice of “night builds”, but instead of builds being made overnight, they’re made in real-time, further reducing the impact from “bad commits”.

In general, continuous integration is almost a must-have for any serious development, how to implement it – is a different story.

Traditional way of doing it is to run build automagically right after the commit. Then – if the build fails – red flag is raised, and then one of two things happens:

  1. the commit is automatically rolled back, or
  2. the developer who’s committed the Bad Thing, is notified – and “nobody has a higher priority task than fixing the build” (attributed to Kent Beck by (Fowler)). This is a standard way of doing things, but it is rather disruptive. Moreover, with peculiar (to put it mildly) way git revert works for merges – reverting merge commit will not restore the previous state of the system, and merging the same branch again will require quite a bit of jumping through the hoops – potentially causing really unexpected and counter-intuitive results in the long run (see (kernel.RevertFaultyMerge, n.d.) for detailed discussion).

As a result of this very annoying peculiarity (and other considerations such as avoiding fear that my commit will break the build – which makes developers skip commits which is pretty bad too) – I became a strong proponent of running the build before the commit (not after the commit) – and committing only if the build is ok. Of course – developer running local build before committing has been a standard practice for years, but (as any other manual process) it is prone both to different configurations and to human errors.

Overall, I am on the side of those people who’re saying that such build -> run-tests –> commit-only-if-ok sequence should be a responsibility of good CI system. In practice can be done either as DIY (via pre-commit hooks7) – or using “delayed commit” (a.k.a. “pre-tested commit”) by CI tools such as Jenkins or TeamCity (NB: I didn’t try Jenkins or TeamCity, so I cannot tell how they deal with reverting merges, which is a big pain in the… ahem, neck).

 


7 Note that post-commit scripts with revert will cause problems with git because of reverting merges peculiarities.

 

3rd-party Libraries: Licensing

One really important thing to remember when developing your game is that no 3rd-party library can be used without taking into account its license. Even open-source libraries can come with all kinds of nasty licenses which may prevent you from using them for your project.

In particular, beware of libraries which are licensed under GPL family of licenses (and of so-called “copyleft” licenses in general). These licenses, while they do allow you to use code for free, come with a caveat which forces you to publish (under the very same license) all the code which is distributed together with the 3rd-party library.8 There are a few mitigating factors though. First, LGPL license (in contrast to GPL license) is not that aggressive, and usually might be used without the need to publish all of your own code (while changes to library code itself will still need to be published, this is rarely a problem). Second, if you’re not distributing your server-side code9 – then only the client-side code will usually need to be published (which tends to help a lot for web-based games). In any case, if in doubt – make sure to consult your legal team.

Hare wondering if you are crazy:Be careful with open-source projects which don't have any license at allAnother two things to be aware of in open-source projects, is (a) “something under license which is not a recognised open-source license (see [OpenSource] for the list of recognised ones), and (b) “something without any license at all” (you’ll see quite a few such projects on github). (a) is usually a huge can of worms, and in case of (b) you cannot really use the project in any meaningful way (by default, everything out there is subject to copyright, so to use it – you generally need some kind of license).

On the other hand, anything which goes under BSD license, MIT license, or Apache license – can usually be used without licensing issues.

And of course, if you’re using commercial libraries – make sure that you’re complying with their terms (paying for the library does not necessarily mean that you are allowed to use it as you wish).


8 in practice, it is more complicated than that, but if you want legally correct answers – you better ask your legal team
9 distribution of server-side code may happen, for example, if you’re selling your server-side as an engine

 

Development Process

The next thing which you will need is almost-universally necessary (that is, unless you’re a single-developer shop) and pretty much universally hated among developers. It is related to the mechanics of the development process. All of us would like to work at our leisure, doing just those things which we feel like doing at the moment. Unfortunately, in reality development is very far from this idyllic picture.10

For your game, you do need a process, and you do need to follow it. What kind of process to use – old-school project Gannt-chart-based planning with milestones, or agile stuff such as XP, Scrum, or Kanban – is up to you, but you need to understand how your development process is going to work.

Scared hare:I am not going to discuss advantages and disadvantages of different processes here, as the associated debates are going to be even more heated then Linux-vs-Windows and C++-vs-Java holy wars combined. I am not going to discuss advantages and disadvantages of different processes here, as the associated debates are going to be even more heated then Linux-vs-Windows and C++-vs-Java holy wars combined. Usually, however, you will end up with some kind of a process, which is (whether you realize it or not) will be some combination of agile methods; in at least two of my teams, we were using a combination of Scrum and XP long before we learned these terms 🙂 .

BTW, if you happen to consider Agile as a disease (like, for example, [AgileDisease]) – that’s IMNSHO not because agile is bad per se, but most likely because you’ve had a bad experience dealing with an overly-confident (and way too overzealous) Certified Scrum Master who was all about following the process without even remote understanding of specifics of your project (and quite often – without any clue about programming). While I do admit that such guys are indeed annoying (and often outright detrimental for the project), I don’t agree that it makes the concepts behind agile development, less useful even by a tiny bit.

One thing which should be noted about agile criticisms (such as  [AgileDisease]), is that there is no real disagreement about what needs to be done; the sentiment in such criticisms is usually more along the lines of “we’re doing it anyway, so do we need fancy names and external consultants?” To summarize my own feelings about it:

Do you need to have a well-defined development process? Certainly. All successful projects have one, even if it is not formalized.
Do you need to have it written down? Up to you. At some point you’ll probably need some rules written down, but it is not a strict requirement.
Does your project need to be iterative? Certainly
Do you need to have your iterations reasonably short (3 months being “way too much”)? Certainly
Do you need to name your iterations “sprints”? Doesn’t matter at all
Do you need to have your iteration carved in stone after it started? It depends, pick the one which works for you at a certain stage of your project
Do you need to analyze how your iteration went? A good idea, whether naming it “iteration” or “sprint”
Do you need to describe your goals in terms of ‘use cases’/’user stories’?11 Certainly
Do you need to name them ‘use cases’/’user stories’? Doesn’t matter at all
Do you need to name your project “Agile”, or “Scrum”, or <insert-some-name-here>? Doesn’t matter at all
Do you need a daily stand-up meeting? Up to you, but often it is not so bad idea
Do you need Product Owner (as a role) You SHOULD. It is damn important to have opinion of stakeholders to be represented
Do you need Product Owner as a full-time role? Not necessarily, it depends
Do you need to name this role “Product Owner”? Doesn’t matter at all
Do you need Scrum Master (as a role)? You will have somebody-taking-care-of-your-development-process (usually more than one person), whether you name it “Scrum Master” or not
Do you need a Kanban board? Up to you
Do you need to use XP’s techniques such as pair programming, merciless refactoring, test-driven development? Up to you on case by case basis
Do you need a Certified Scrum Master on your team? Probably not
Do you need an external consultant to run your Agile project? If you do – your team is already in lots of trouble

Ultimately, whether you’re using fancy names or not, your process will be a combination of agile processes, using quite a few agile techniques along the road. And it doesn’t matter too much whether you’re doing it because you read a book on agile, or because you’ve invented them yourself.


10 it applies to any kind of development, game or not
11 while they’re not exactly similar, they’re close enough for our purposes now

 

Issue Tracking System

Hare with hopeless face:Whether we like it or not, there will be bugs and other issues within our game.Whether we like it or not, there will be bugs and other issues within our game. And even if there would be a chance that we wouldn’t have any bugs – we’ll have features which need to be added. To handle all this stuff, we need an issue tracking system.

If you’re hosted on github, and your team is really small (like <5 developers) – you MIGHT get away with github built-in issue tracker. If you’re hosting your own git server (or if your team is larger), you’re likely to use some 3rd-party issue tracking. The most popular choices in this regard range from free Bugzilla, Trac, and Redmine, to proprietary (and non-free as in “no free beer”) JIRA.

Which one is better – honestly, IMHO it doesn’t matter much, and any of them will do the job, at least until you’re running a 1000-people company12 (in particular, all 4 systems above do allow to integrate with git).

One extra thing to think about in this regard is support for the artifacts used within your development process. Whether you want to use a Kanban board, Scrum “burndown chart”, or a good old Gantt chart (or all of them together) – having these artefacts well-integrated into the same system which provides you with issue tracking can save you quite a bit of time. More importantly – it may help you to follow your own development process. So think about artifacts of your development process, and take it into account when choosing your issue tracking system. Also keep in mind that some of the plugins which implement this functionality (even for free systems(!)) can become pricey, so it is better to check pricing for them in advance.

On the other hand, this support-for-development-process-artifacts is only a nice-to-have feature of your tracking system; you can certainly live without it, and it only comes into play when all-other-parameters of your issue tracking system are about-the-same for your purposes. On the third hand 😉 , these days issue tracking systems are pretty much about-the-same from purely issue-tracking point of view.13


12 and if you do, you should look for a better source than this book for choosing your issue tracking system, as issue tracking is very far from being a focus here
13 I realise how hard I will be beaten for this statement by hardcore-zealots-of-<insert-your-favorite-issue-tracking-system> but as an honest person I still need to say it

 

Issue Tracking: No Bypassing Allowed

There is one very important concept which you MUST adhere to while developing pretty much any software product:

ALL the development MUST go through the issue tracking system

It means that there MUST be an issue for ANY kind of development (and for each commit too). Granted, there will be mistakes in this regard, but you MUST have “each commit MUST mention its own issue” policy. The only exception to this rule should be if it is not a feature, but an outright bug, and the whole issue can be described by developer in the commit message.

It is perfectly normal for a BA to come into developer’s cubicle and saying “hey, we need such and such feature, let’s do it”. What is not normal – is not to open an issue for this feature (before or after speaking to the developer). As for using e-mails for discussing features – I am against it entirely, and suggest to have an issue open on the feature, and to have all the discussion within the issue. Otherwise, 3 months down the road you will have lots of problems trying to find all those e-mails and to reconstruct the reasons why the feature was implemented this way (and whether it is ok to change it to a different way).

Even for a team of 5, for every change in the code, it is crucial to know why it has been made, and there should be one single source of this information – your issue tracking system.

Coding Guidelines

Hare pointing out:One last thing you should establish before you start coding, is coding guidelines for your specific projectOne last (but certainly not least) thing you should establish before you  start coding, is coding guidelines for your specific project. In this regard my suggestion is not to copy a Big Document from a reputable source,14 but rather start writing your own (initially very small) list of DO’s and DON’Ts for your specific project. This list SHOULD include such things as naming conventions, and all the not-so-universal things which you’re using within your project. More on naming conventions and project peculiarities below.

Of course, your guidelines.txt file belongs to your source control system. And while you’re at it – do yourself a favor and find for it the most prominent place you can think of (root directory/folder of your project is usually a pretty good candidate).


14 this book included; in Chapter [[TODO]] there will be an example of my personal guidelines for C++, but as with any other source – don’t copy it blindly

 

Naming Conventions

With naming conventions the situation is simple: it doesn’t really matter which naming convention you use (myFunction() vs my_function() won’t make any realistic difference, and debating it for hours is not worth the time spent). What is important though, is to do it uniformly across the whole project, so you should just quickly agree on some naming conventions and then adhere to them.

That being said, there is one thing in this regard which I actively dislike and which I am arguing against (on the basis that it reduces readability) – it is so-called “Hungarian notation”. If you really really feel like naming your name variable as lpszName – the sky won’t fall, but I suggest to drop these prefixes completely.

As for having some kind of naming convention for class data members – two popular conventions are mDataMember and data_member_, this is up to you whether to have such convention, it won’t make that much difference anyway (that is, as long as you’re using it consistently across the whole project).

Project Peculiarities

Hare asking question:For a C++ project there is a common question whether you'll be using printf() or ostream for formatted output – regardless of your decision, it needs to be consistent for the whole projectFor pretty much every project you will have some peculiarities. For example, as we’ll be programming within our ad-hoc FSMs, then threads will be pretty much out of question (at least outside of well-defined areas) – ok, so let’s write it down into our guidelines.txt file (to the part which tells about FSMs). For a C++ project there is a common question whether you’ll be using printf() or ostream for formatted output and logging – regardless of your decision,15 it needs to be consistent for the whole project, so it also belongs to Code Guidelines. And so on, and so forth.

For C++, my personal set of Coding Guidelines will be discussed in Chapter [[TODO]], but as with any other 3rd-party source, you shouldn’t copy it blindly and should develop your own one, based on your own task, your own style, and your own design decisions.16


15 FWIW, my answer is ‘neither – use cppformat instead’, see Chapter [[TODO]] for further discussion
16 roughly translated as: “whatever nonsense I write there, it is your responsibility to filter it out, so don’t blame me if it doesn’t work for you” 😉

 

Per-Subproject Guidelines

One important thing to be mentioned here is that most of the projects will actually need more than one set of coding guidelines. Not only the subprojects can be written in different programming languages, but also subprojects can perform very different jobs, what in turn requires different guidelines.

For example, even if all your code is written in C++, the guidelines for infrastructure layer (the one outside of FSMs) and application layer (implementing FSMs) is going to be quite different. The former is going to use threads, will probably provide logging facilities so it will need to have direct file access (and probably access OS-specific services too), etc., and the latter is basically going just to call whatever-is-provided-by-infrastructure layer (concentrating on game logic rather than on “how to interact with OS”).

As a result, I strongly suggest to use different guidelines for different layers of your game even if all of them are written in the same programming language; at the very least, they should be quite different between 3D engine, network engine, and game logic.

Enforcement and Static Analysis Tools

All the rules and guidelines are useless if nobody cares to follow them. Even if it is only somebody who ignores the guidelines, if such ignoring-guidelines-code is not rectified soon enough, it is often used as an example for some other piece of code, and so on, and so forth, which means a slippery road towards most of the code ignoring the guidelines 🙁 .

To deal with all such guideline violations, there is no real substitute for code reviews. However, to catch some of them, it is usually a good thing to use an automated tool which will complain about most obvious violations. Such tools are specific to the programming language; list of such “static analysis” tools which (as I’ve heard, no warranties of any kind) work in real-world projects, include:

  • checkstyle (Java). Checks for naming convention compliance etc.
  • astyle (C/C++/Objective-C/C#/Java). Re-formats your source according to your preferences. Personally, I like to have a policy of “before committing to develop branch, all the code should be run through astyle”.
  • StyleCop (C#).
  • cpplint (C++). Style checks against Google C++ style guide. Not to be confused with lint.

Actually, static analysis tools go much broader than mere style checking, and quite a few of them can find bugs.  Most popular static analysis tools in this regard include:

  • cppcheck (C++)
  • PMD (Java)
  • PC-lint (C/C++). Commercial.

There are also lots of other static analysis tools out there (see [Wikipedia.StaticCodeAnalysis.Tools]), but quite a few of them are known to cause more trouble then provide benefits (one of common problems of many tools is having too many false positives), so don’t hold your breath until you tested the tool and see that it works for you.

[[This Concludes Part ARCH(itecture). To Be Continued in Part PROG(ramming)…

Tired hare:This concludes beta Chapter 11 from the upcoming book “Development and Deployment of Massively Multiplayer Games (from social games to MMOFPS, with social games in between)”. Moreover, this concludes “beta” of the whole part ARCH(itecture), yahoo! Further chapters from 2nd part PROG(ramming) will follow soon…]]

Don't like this post? Comment↯ below. You do?! Please share: ...on LinkedIn...on Reddit...on Twitter...on Facebook

[+]References

Acknowledgement

Cartoons by Sergey GordeevIRL from Gordeev Animation Graphics, Prague.

Join our mailing list:

Comments

  1. Wanderer says

    As always, nice and mostly in line with my own experience. Fun fact – we use this exact Vincent Driessen’s article about git branching as a part of a “have-to-read-and-follow” list of things for any new developer here.

    Also, the team might have to add some additional rules regarding git usage and development process depending on the language/platform. IMHO, best example of that is Unity3D scenes files (.unity). Those are in binary format, so there are no goodies of semi-automated merge and conflicts resolution process. So, for mobile clients we usually end up having some ugly process with file locking and a place/chat to declare those locks. Actually, this is one more thing why I prefer to avoid Unity at all costs.

    As of naming conventions, I know that our Java team used “checkstyle” (http://checkstyle.sourceforge.net/index.html) on some projects and with more or less good results. I don’t know about any similar tools for other platforms/languages, unfortunately.

    Finally, I’d like to put my 2 cents on built-in github and bitbucket issue trackers. These can be enough in the beginning, but they are too rigid and lack some necessary features, namely, good support of different statuses. Basically, all you get is “open/closed” state for issue. And, based on my experience, this is totally not enough for any non-trivial workflow that requires states like “in progress” or “QA” or “waiting for deployment”. The latter becomes handy as soon as the project goes live and actual production code “master” branch lags behind “develop” branch.

    Of course, one can get away using various nice-colored tags in github built-in tracker, for example. However, it’s not as informative and robust, based on my experience.

    And, sad fact, migrating from “simple” built-in tracker to “real” task-management system on later stages of development is definitely possible, but it’s not that easy. So, I usually suggest to adopt some more complex tool from the very beginning, be it Trac, Redmine, JIRA or something like “all-in-one” Codebase.

    Finally, I usually try to make sure that all main users of that system are fine with it. My premise is that the average developer should be fine with any system, but there are a few key persons – Lead developer and/or Architect, QA (or Head of QA in case there more than one), and “main stakeholder” (like Game Designer or Business/Requirements Analyst etc) – these will spend a lot of time within that system. If they are not OK with it, I often see some kind of “almost-subconscious” sabotage of such system, usually in form of emails, Skype/Slack messages, and even verbal RL requests that never get into tracker.

    That leads me to the final point – it doesn’t matter what system is used, it can be Trac, Redmine, Bugzilla, JIRA, Codebase, VersionOne, Pivotal Tracker (or whatever other dozen of systems I have experienced myself), once defined, *all* activities/tasks should be passed through it, no exceptions. Once you start allowing “task passed by email” or “he just came into my room and asked to change X” – the visibility and transparency of things are ruined. As with the requirements/design documents – it can be confluence or google doc or whatever, but there should be “Single Point of Truth” for the team.

    • "No Bugs" Hare says

      Thanks a lot for the post (it was really useful, and a big one too :-)).

      > Fun fact – we use this exact Vincent Driessen’s article about git branching as a part of a “have-to-read-and-follow” list of things for any new developer here.

      As half of the Internet is using “Git Flow” by Driessen these days, it is not that much of a coincidence 😉

      > IMHO, best example of that is Unity3D scenes files (.unity). Those are in binary format, so there are no goodies of semi-automated merge and conflicts resolution process.

      THANK YOU, forgot about this stuff 🙁 . Added a section on “Git and unmergeable files” (note that I prefer “lock” files to out-of-git communication channels – essentially using the same Single Point of Truth paradigm which you’re suggesting for Issue Tracking).

      > Java team used “checkstyle”

      THANK YOU! Here goes another section (“Enforcement and Static Analysis Tools”)

      > These can be enough in the beginning,

      THANK YOU, they indeed tend to work good only for very small teams, added a note about it.

      > *all* activities/tasks should be passed through it, no exceptions.

      Yep, THANK YOU! Added yet another section “Issue Tracking: No Bypassing Allowed”

      Thanks a lot, and if you disagree with additions – please feel free to comment further 🙂

  2. mikhail says

    > IMHO, best example of that is Unity3D scenes files (.unity). Those are in binary format, so there are no goodies of semi-automated merge and conflicts resolution process.

    AKAIK, you can change binary format to text for all assert metadata and scene file.

    • "No Bugs" Hare says

      I will need to check it; potential problem on this way is that having assets in text does NOT guarantee them to be mergeable. Two most obvious Bad Examples of such text-but-unmergeable files are Wavefront .obj, and pretty much all Poser’s files :-(.

  3. Daniel Wegener says

    “use Travis CI as your Continuous Integration tool” is IMO a bit too specific. Most CI servers out there (even Jenkins) are able to build feature branches (either via polling or web-hooks) and most SCM-Browsers (GitHub, GitLab, Stash AFAIR) have a notion of PullRequest/MergeRequest status API that can indicate red/green build on your CI.

    I think the advice should rather be like: “Let the CI server build/test your feature branches before you merge them to the origin dev/master branch, enforce it via Pull/MergeRequests and no direct commits to the origin dev/master branch”

  4. Kuvis says

    I just wanted to comment on your suggestion regarding the use of GitHub – it would be nice of you, just out of fairness, to mention that there are other sites like it out there. Gitlab for example offers unlimited private repositories unlike GitHub (unless the situation has changed with GitHub since last I checked), and a lot of people are probably aware of Atlassians Bitbucket.

    I also wanted to mention that I think the way you talked about the GPL family of licenses felt a bit off, as it seemed like you were calling it a “nasty” thing that they enforce that the freedoms given to users are also passed forward in future forks of a project. I would suggest you instead mention that using copyleft-licensed software in a proprietary project can lead to problems, but that this is a non-issue if you’re using a compatible, ethical license yourself.

    • "No Bugs" Hare says

      As for the Gitlab/Bitbucket – I added them (though for private repos only). THANKS!

      > using copyleft-licensed software in a proprietary project can lead to problems

      Using GPL’d libraries can easily lead to major problems in an open-source project too. If some team has their million-LOC project under MIT/BSD/… license – then adding a 1000-LOC GPL’d library pretty much automatically brings the whole project (with ALL million LOCs) under the GPL (unless somebody makes an effort and separates GPL’d part). And if it happens (just for the sake of argument) that the team doesn’t believe that “in bondage placing-restrictions-on-work-produced-by-others we’re free” – they have a huge economy-size problem on their hands (exactly because of “viral”/”greedy” nature of GPL). LGPL is fine – and it has been mentioned.

  5. Bulat Shamsutdinov says

    Hi!

    Have you ever encountered https://github.com/kbengine/kbengine ?

    If you did, can you please share your thoughts on it?

    It looks like alive project developed constantly, using a nice stack with C++ and Python and it has client libs for all major engines.

    But as a newcomer to MMOG world, I’m afraid to make my judgement ob something so massive.

    Thank you!

Leave a Reply

Your email address will not be published. Required fields are marked *

This site uses Akismet to reduce spam. Learn how your comment data is processed.